Senior Data Engineer

Job Title: Data Engineer

Position Overview:

Our client seeking a Data Engineer to join their growing team. This role is crucial to ensure the seamless flow of data pipelines, maintain current systems, and support new AI research initiatives. The ideal candidate will have a broad knowledge of data engineering concepts, experience in cloud platforms, and a willingness to learn and grow in the role.

Location: 3 office days per week (Tuesday, Wednesday, Thursday).

Key Responsibilities:

• Design, implement, and maintain data pipelines to support data-driven projects and analytics.
• Work with cloud platforms (at least one of AWS, GCP, or Azure) to optimize data processing workflows.
• Collaborate with the team to support open-source technologies and integrate them into existing systems.
• Maintain and enhance existing projects while actively contributing to new projects, including AI research initiatives.
• Implement workflow orchestration tools such as Airflow to automate tasks and processes.
• Learn and adapt to new technologies as required to improve solutions and workflows.

Qualifications:

• Experience: Minimum of 3 years as a Data Engineer or similar role.
• Technical Skills:
  • Strong knowledge of data pipeline design and implementation.
  • Familiarity with at least one cloud platform (AWS, GCP, or Azure).
  • Experience with workflow orchestration tools (e.g., Airflow).
  • Exposure to open-source tools and technologies.
  • Willingness to learn real-time processing and other advanced technologies.
• Preferred Background:
  • Experience in consulting firms is a plus, but from in-house roles with the required skills are welcome.
  • Hands-on experience in developing end-to-end solutions.