Lead Data Engineer

Company Overview

Emids is dedicated to digging deeper and going further. At the intersection of design, engineering, and domain expertise, we work with customers to blaze new trails and positively impact the future of health. Our mission emphasizes innovation, collaboration, and positive outcomes for both our clients and the communities we serve.

Summary of the Role

We are looking for a highly skilled Lead Data Engineer to join our growing Data Engineering team. This position is well-suited for an individual with strong expertise in AWS, Databricks, PySpark, and Airflow who will be responsible for designing, building, and optimizing scalable data pipelines and solutions. You will play a crucial role in enabling advanced analytics, machine learning, and business intelligence across the organization.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, and Airflow.
• Build and optimize data models and data lakes/warehouses on AWS.
• Implement best practices for data quality, data governance, and performance optimization.
• Collaborate with cross-functional teams (data scientists, analysts, product, and business teams) to deliver data-driven solutions.
• Ensure reliability, scalability, and efficiency of data workflows through automation and monitoring.
• Troubleshoot complex data engineering issues and optimize processing performance.

Required Qualifications

Must-Have

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 8-12 years of hands-on experience in Data Engineering.
• Strong expertise in PySpark, Databricks, and Airflow for large-scale data processing and orchestration.
• Solid experience with AWS services such as S3, Glue, Redshift, EMR, Lambda, and IAM.
• Strong knowledge of SQL and performance tuning.
• Strong problem-solving skills, communication, and ability to work in a fast-paced environment.

Nice-to-Have

• Experience with CI/CD pipelines, Git, and containerization (Docker/Kubernetes) is a plus.

Compensation and Benefits

Emids offers a competitive compensation package that includes:

• Attractive base salary
• Performance-based bonuses
• Comprehensive health and wellness benefits
• Retirement savings plan with company match
• Generous paid time off policy
• Flexible work arrangements

Additional Information

We value innovation and growth, providing an environment that encourages professional development. At Emids, you will have the opportunity to:

• Work on impactful projects that contribute to the health industry's advancement.
• Collaborate with a talented and passionate team.
• Be a part of a culture that prioritizes diversity, inclusion, and belonging.