Job Openings Data Engineer

About the job Data Engineer

Key Responsibilities:

  • Design, develop and maintain data pipelines for data ingestion, integration, transformation, storage and processing across cloud and enterprise data platforms.
  • Integrate data from multiple sources, including databases, APIs, files, streaming sources, IoT and OT systems.
  • Develop and maintain data processing workflows to support enterprise data requirements and downstream analytics use cases.
  • Implement data validation, quality checks, monitoring and error-handling mechanisms to ensure data accuracy and reliability.
  • Work with SQL, Python or equivalent programming languages, ETL frameworks and data orchestration tools to develop and maintain data engineering solutions.
  • Support the development and maintenance of data lakes, data warehouses and data models.
  • Apply version control and relevant data engineering practices to ensure maintainable and reliable data solutions.
  • Support data governance activities, including metadata management, data lineage, access control and data lifecycle management.
  • Collaborate with senior data engineers, software engineers, cloud engineers and other technical stakeholders to support data platform implementation and maintenance.

Requirements:

  • At least TWO (2) years of experience as a Data Engineer or in a similar data engineering role, including the design, development and implementation of data pipelines, data ingestion and integration workflows, data transformation, data storage and data processing solutions on cloud and/or enterprise data platforms.
  • Experience in integrating data from multiple sources, including structured and unstructured data, APIs, databases, files, streaming sources and/or IoT or OT systems, and implementing appropriate data quality, validation, monitoring and error-handling mechanisms.
  • Experience with relevant data engineering technologies and practices, including SQL, Python or equivalent programming languages, ETL frameworks, data lakes and/or data warehouses, data modelling, orchestration and version control.
  • Experience in implementing data governance, metadata management, data lineage, access control and/or data lifecycle management requirements within enterprise data environments.