About the job Data Engineer
Job Location: hybrid in Bucharest
Recruitment process:
- HR screening
- Technical discussion
Role description:
Our client is a Brussels-based fashion-tech startup leveraging the value within the tremendous amount of online information published every day. With hundreds of thousands of reference details acquired daily, we deliver real-time and accurate insights to fashion industry decision-makers.
We are seeking a skilled and motivated Data Engineer to join our client's team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines for both batch processing and real-time streaming of large datasets. You will also manage databases by designing efficient structures, optimizing indexes, and ensuring reliable backups.
Key Responsibilities:
- Design, build, and maintain scalable and efficient data pipelines for batch and real-time data processing.
- Manage relational and non-relational databases, including optimization and ensuring data integrity.
- Collaborate with cross-functional teams to deliver reliable and high-performance data solutions.
- Optimize workflows and processes to handle large datasets effectively.
- Ensure data security, reliability, and scalability across all operations.
Profile :
- Database Management: Proficiency in relational databases (MySQL, PostgreSQL) and non-relational databases (MongoDB, Redis, ScyllaDB).
- Programming: Strong experience in Python for data manipulation and application development.
- Cloud Platforms: Hands-on experience with Google Cloud Platform (GCP) and Microsoft Azure.
- Workflow Management: Familiarity with tools like Apache Airflow to automate and monitor workflows.
- Data Processing Frameworks: Experience with tools like Google Dataflow, Apache Beam, and Flink for large-scale data processing.