Tech Lead in Data Engineering (M/F)

Tech Lead Data Engineering

Position Overview:


As a Tech Lead in Data Engineering, you will serve as a key technical advisor to stakeholders, own end-to-end data engineering initiatives, manage technical debt, and mentor junior engineers. You will play a critical role in designing, architecting, and building robust, scalable data solutions.

This role requires a strong software engineering mindset, with proven experience writing production-grade Python code, and solid expertise in Azure, Databricks (PySpark), and SQL.

Key Requirements:

• Lead the design and development of batch and real-time data pipelines using tools like Databricks, PySpark, and DBT.
• Optimize data storage formats (e.g., Delta Lake, Parquet) and implement data quality checks.
• Collaborate with data scientists and analysts to provide seamless access to data for analytics and machine learning.
• Manage Azure cloud infrastructure and ensure compliance with data privacy regulations.
• Mentor junior team members and promote best practices in data engineering.

Requirements:

• Masters or PhD in a related field.

• Python: minimum of 5 years of production-level coding experience
• SQL: advanced level
• Azure (Data Factory, managed services): minimum of 2 years of experience
• Databricks with PySpark: minimum of 3 years of experience
• Fluent English
• Proven experience in building production pipelines, making technical decisions, and mentoring other engineer.
• Strong skills in data architecture, ETL processes, and cloud infrastructure management.
• Experience with CI/CD tools and data security best practices.