Senior Data Engineer (ADF & Databricks Specialist)

WE ARE HIRING !!!

Senior Data Engineer (ADF & Databricks Specialist)

We are looking for a highly skilled Senior Data Engineer with expertise in Azure Data Factory (ADF) and Databricks to join our team. The ideal candidate will play a key role in managing, optimizing, and automating data workflows.

Key Responsibilities

• Design, develop, and optimize data pipelines using Azure Data Factory (ADF) and Databricks.
• Provide subject matter expertise in Databricks, including performance optimization, best practices, and advanced analytics solutions.
• Support and troubleshoot administrative requests and tickets related to ADF and Databricks.
• Ensure data governance, security, and compliance within the Azure ecosystem.
• Develop monitoring and alerting mechanisms to enhance the performance and reliability of ADF and Databricks workflows.
• Assist in the integration of various data sources into a centralized data platform.

Required Skills & Qualifications

• Minimum 3-5 years of experience as a Data Engineer with a focus on Azure Data Factory (ADF) and Databricks.
• Bachelor's degree (B.Sc) in Computer Science, Engineering, or a related field.
• Strong expertise in designing and implementing ETL/ELT pipelines.
• Proficiency in PySpark, Scala, or SQL for Databricks development.
• Hands-on experience with performance tuning and data governance best practices.
• Knowledge of Azure cloud services, including Azure Synapse, Azure Storage, and other data-related services.
• Experience with monitoring and troubleshooting ADF and Databricks processes.
• Ability to work in a collaborative team environment and support multiple stakeholders.

Preferred Qualifications

• Certification in Azure Data Engineering (DP-203) or related certifications.
• Experience with DevOps practices and CI/CD pipelines for data workflows.
• Familiarity with infrastructure-as-code tools like Terraform is a plus.
  
  Ready to take your career to new heights?
  
  We're InTalent Asia, your go-to recruitment partner in Sri Lanka, and we've got an exciting opportunity for you! Our client is looking for a dynamic individual to fill the role of Senior Data Engineer
  At InTalent Asia, we're not just recruiters; we're here to architect your career success. Join us in the journey of matching your skills with unparalleled opportunities.
  
  Apply now and see how you can be the perfect fit for this exclusive position!
  
  #InTalentAsia #CareerOpportunity #JobVacancy #ElevateYourCareer