Data Engineer

Data Engineer

About the Role

We are seeking a dedicated Data Engineer to join our data team in supporting the digital transformation of one of Japans leading logistics companies. In this role, you will design and implement reliable, scalable data pipelines and develop self-service tools to empower business teams. Your work will directly contribute to improving operational efficiency, data quality, and decision-making across the organization.

Responsibilities

• Build and optimize robust data pipelines on a data lake platform to support business operations and analytics.
• Develop and maintain self-service tools for data orchestration, monitoring, and quality checks.
• Implement data validation, observability, and lineage processes to ensure data accuracy and traceability.
• Design and maintain well-structured data models to support reporting and analysis.
• Collaborate closely with data analysts and stakeholders to understand data needs.
• Mentor and coach junior engineers, fostering a collaborative and high-quality engineering culture.
• Contribute to continuous improvement of development processes and best practices.

Requirements

• 4+ years of experience designing and building data pipelines on data lakes.
• Strong hands-on experience with Apache Airflow for workflow orchestration.
• Proficient in SQL and Python (Scala experience is a plus).
• Strong knowledge of data quality, validation, observability, and testing frameworks.
• Experience with Docker and Kubernetes in production environments.
• Strong organizational and project management skills, with the ability to handle multiple projects.
• Excellent communication and teamwork skills, with a proactive and solution-oriented mindset.
• Passion for continuous learning, knowledge sharing, and contributing to team success.