Databricks Developer Job at SCIGON Solutions, Franklin Park, IL

T3JNdS9jQXhhb29PTnl5YTdKSDRTVjBGSFE9PQ==
  • SCIGON Solutions
  • Franklin Park, IL

Job Description

Design, develop, and maintain scalable data pipelines and ELT/ETL workflows using Databricks and Apache Spark (PySpark/Spark SQL) Build and optimize modern lakehouse architectures using Delta Lake and related data formats (e.g., Parquet, Iceberg) Develop production-grade data workflows using Databricks Workflows and/or declarative pipeline frameworks Implement data governance, security, and access controls using Unity Catalog and related enterprise frameworks Support data migration and modernization initiatives , transitioning legacy data warehouse systems to cloud-based platforms Apply medallion architecture principles (bronze, silver, gold layers) in scalable solution design Implement CI/CD pipelines and infrastructure-as-code for Databricks environments (e.g., Terraform, Databricks Asset Bundles, GitHub Actions) Monitor, troubleshoot, and resolve production data pipeline issues to ensure system reliability and performance Collaborate with technical and business stakeholders to gather requirements and translate them into scalable data solutions Participate in code reviews, testing, documentation, and deployment activities Contribute to the continuous improvement of data engineering standards, tools, and best practices Provide technical support during solution implementation and stabilization phases Perform other duties as required What You Will Need Bachelor’s degree in Engineering, Information Technology, Computer Science, or a related field (or equivalent experience) 5+ years of data engineering experience , with at least 4+ years focused on Databricks Strong proficiency in Apache Spark (PySpark and/or Spark SQL) and advanced SQL Experience designing and implementing solutions on AWS, Azure, or GCP Proven experience in cloud modernization, data migration, and data warehousing initiatives Strong understanding of data security, messaging patterns, ELT processes, and data integration architectures Hands-on experience with cloud computing, database technologies, and data processing frameworks Ability to prioritize tasks, manage multiple responsibilities, and contribute to high-performing, collaborative teams Excellent verbal and written communication skills, with the ability to engage effectively across technical and business audiences Highly analytical, detail-oriented, and self-motivated, with a strong sense of ownership and urgency Demonstrated ability to quickly learn and apply new technologies to support enterprise data solutions Highly Desired Experience facilitating technical workshops with both technical and business stakeholders to drive solution alignment and value delivery Familiarity with advanced analytics tools, programming languages, and data visualization platforms Experience with data integration / EAI frameworks Nice to Have Databricks certification Experience in business analytics design and development , including exposure to best-in-class platforms and tools Working knowledge of business processes and enterprise systems Strong skills in change management, communication, and business process improvement Skills : Data Engineering,Databricks,Apache Spark #J-18808-Ljbffr

Job Tags

Similar Jobs

Community Health Systems

Radiology Assistant Job at Community Health Systems

 ...Job Title: Radiology Assistant Position Type: PRN Location : 6101 Pine Ridge Rd, Naples, FL Shift: Various Schedule: Various Job Summary The Radiology Assistant supports the daily operations of the imaging department by assisting technologists, preparing... 

NaphCare

Craft CMS Web Designer Job at NaphCare

 ...NaphCare has an excellent opportunity for a Craft CMS Web Designer to join our join our Corporate Office in Birmingham, AL. This...  ...individual maintains confidentiality, remains open to others' ideas and exhibits willingness to try new things. Oral communication-the... 

Stellantis

UX/UI Visual Sr Designer Job at Stellantis

 ...Our global creative team consists of a diverse group of User Experience Designers, Interaction Designers, 2D/3D Visual Designers, Motion Graphic...  ...with our customers. What you will Do: As a UX/UI Visual Designer at Stellantis, you will establish the look... 

RG&T Solutions

Game Tester Job at RG&T Solutions

 ...We are seeking a dedicated Remote Game Tester based in Fort Worth, Texas, to join our dynamic team. In this role, you will be responsible for thoroughly evaluating new and existing video games to identify bugs, glitches, and gameplay issues to ensure a high-quality gaming... 

Collins & Jewell Company

Trades I Job at Collins & Jewell Company

Job Description Job Description Description Company Mission, Vision, and Values: Mission: To develop our people, serve our team, and support our customers, always with integrity. Vision: Instill in our team a unified culture fueled by training...