Senior Data Engineer

Job Description

• As a Senior Data Engineer, you are responsible for designing, building, and maintaining the data infrastructure that enables efficient data collection, transformation, storage, and access across systems. 
• The role ensures that data pipelines are scalable, secure, and optimized to support analytics, machine learning, and business intelligence use cases. 
• The Data Engineer collaborates closely with data scientists, analysts, software engineers, and architects to deliver reliable and high-quality data solutions.

What you will do:

• Design and implement scalable data pipelines to ingest, transform, and deliver data across platforms
• Build and maintain data lakes, data warehouses, and analytical data stores
• Ensure data quality, security, and consistency through validation, monitoring, and automated checks
• Collaborate with data scientists and analysts to make data accessible and analysis-ready
• Optimize data workflows for performance, reliability, and cost-efficiency
• Implement data governance practices such as metadata management, cataloging, and lineage tracking
• Troubleshoot data pipeline issues and perform root cause analysis
• Document data flows, data definitions, and engineering processes

Qualifications

The ideal candidate should possess:

• 5–7 years of hands-on experience as a Data Engineer, delivering production-grade data solutions.
• Proficient in data pipeline development using Python, SQL, or Scala
• Experience with ETL/ELT frameworks and orchestration tools (e.g., Apache Airflow, AWS Glue, dbt)
• Familiarity with data warehousing and big data technologies (e.g., Snowflake, Redshift, BigQuery, Databricks, Hadoop, Spark)
• Strong understanding of data modelling, partitioning, indexing, and schema design
• Knowledge of cloud platforms (AWS, Azure, GCP) and their native data services
• Experience with batch and real-time data streaming (e.g., Kafka, Kinesis)
• Proficiency in data governance, data quality, and data lineage practices
• Familiarity with DevOps, CI/CD, version control, and infrastructure as code (e.g., Terraform)