Senior Data Engineer

Senior Data Engineer

Goal: Independent conception, implementation and operation of data processing pipelines for the provision and preparation of mass data. Ensuring data quality and data availability.

Services & responsibilities:

§ Monitoring and ensuring data quality, data availability and processing performance

§ Provision of interfaces for data exchange

§ Conception, implementation and testing of scalable data processing architectures

§ Conception, implementation and testing of ETL processes in coordination with data scientists and business analysts

§ Close coordination with front-end, back-end engineers, product managers and analysts

§ Application and provision of machine learning and statistical methods for evaluating and predicting patterns in the data

§ Continuous coordination and proactive communication with data protection functions

§ Evaluation and analysis of data sets of various complexity and the development and optimization of the data processing infrastructure based on them

§ Development of solution options in order to get from the actual to the target state as well as evaluation and presentation of the solution options

 

Experience:

§ Several years of experience in the development of cloud-based applications

§ Several years of experience as a software developer or comparable position

§ Several years of experience in the area of ​​agile software development