About the job Data Engineer Databricks Dataiku (Freelance optional)
đź“‹ Tasks and responsibilities
Our client works as an Agile organisation.You will be dedicated to a large transformation project, with other Databricks/Dataiku developers.
You demonstrate and use your developer experience to develop and maintain complex data transformation pipelines under specific guidelines
You are familiar of working as data engineer in Databricks (on top of AWS)
Your responsibilities will be to:
• Design, develop and maintain scalable data pipelines
• Manage data ingestion processes from various sources (xml ingestion, Kakfa, etc.).
• Implement and optimize ETL (Extract, Transform, Load) processes to ensure efficient data transformation and integration.
• Ensure data quality, integrity, and security across all data pipelines.
• Monitor and troubleshoot data pipeline performance, implementing necessary maintenance and updates.
• Document data pipeline processes, technical specifications and best practices.
• Realize knowledge transfer towards the Data engineer team which will take over the responsibility to run the platform in the future
đź“ťYour profile
- Extensive experience as a data engineer
- Experience coaching more junior engineers
- Databricks
- Python
- SQL
- Energy Market processes
- DATAIKU
- SAS
Fluent in FR-EN or NL-EN is a MUST (and understanding of other language NL/FR)
đź’Ľ Offer
You will be part of a growing Belgian SME where initiative and personal development are encouraged. We will provide you with an enjoyable work environment with fun colleagues. We will work out a career plan with you, with attention and a budget for extra education/certification. You can count on an attractive salary, supplemented with extra-legal benefits, including a company car.
(Freelance is also possible)