Senior Data Engineer - Azure Databricks

Our client is seeking a Senior Data Engineer to join its Enterprise Data and AI organization and work as an embedded member of the Product Data team.

This engineer will own production data solutions from design through deployment and verification. The role requires strong hands on experience with Azure Databricks, Python, PySpark and SQL, along with the ability to collaborate directly with architects, governance partners, engineering managers and business stakeholders.

The successful candidate will be comfortable entering an existing enterprise environment, learning its frameworks and processes, asking questions when requirements are unclear and independently demonstrating that delivered solutions work in the intended environment.

What you'll work on:

• Design, develop, and maintain production data pipelines using Azure Databricks and Medallion Architecture.
• Build ingestion and transformation processes using Python, PySpark, SQL, and Delta Lake.
• Implement incremental data ingestion using Auto Loader, Databricks Volumes, and Azure storage services.
• Develop and maintain data models, ensuring data quality, consistency, and reliability across Bronze, Silver, and Gold layers.
• Implement data governance, access controls, and row-level security using Unity Catalog.
• Monitor, troubleshoot, and optimize pipelines for performance, reliability, and cost efficiency.
• Own end-to-end delivery, including testing, CI/CD, production deployment, documentation, and collaboration with stakeholders.

Qualifications:

• 5+ years of experience in Data Engineering, including production-grade data solutions.
• Strong hands-on experience with Azure Databricks, Python, PySpark, and advanced SQL.
• Experience with Delta Lake, Medallion Architecture, ETL/ELT, and data modeling.
• Hands-on experience with Unity Catalog, Auto Loader, Databricks Workflows, and Volumes.
• Experience with Azure Data Factory, ADLS Gen2, Azure Blob Storage, and Azure DevOps.
• Knowledge of data governance, access controls, data quality, CI/CD, and performance optimization.
• Strong ownership, problem-solving, and communication skills, with advanced English to collaborate with U.S.-based teams.

Working expectations

This position requires a high level of ownership and transparency:

• Ask questions early when requirements, architecture or acceptance criteriaare unclear.
• Escalate blockers promptly, explaining what was attempted, what wasdiscovered and what assistance is needed.
• Communicate changes to estimates before the original commitment expires.
• Keep stakeholders informed through concise, outcome focused progress updates.

Why apply:

• Remote — work from anywhere in LATAM
• USD compensation
• Paid time off
• High-impact role
• Long-term engagement with stability and ownership
• Structured 30/60/90 onboarding plan that sets you up for success