Goal: Independent conception, implementation and operation of data processing pipelines for the provision and preparation of mass data. Ensuring data quality and data availability.
Services & Responsibilities
- Monitoring and ensuring data quality, data availability and processing performance
- Provision of interfaces for data exchange
- Conception, implementation and testing of scalable data processing architectures
- Conception, implementation and testing of ETL processes in coordination with data scientists and business analysts
- Close coordination with front-end, back-end engineers, product managers and analysts
- Application and provision of machine learning and statistical methods for evaluating and predicting patterns in the data
- Continuous coordination and proactive communication with data protection functions
- Evaluation and analysis of data sets of various complexity and the development and optimization of the data processing infrastructure based on them
- Development of solution options in order to get from the actual to the target state as well as evaluation and presentation of the solution options
Experience
- Several years of experience in the development of cloud-based applications
- Several years of experience as a software developer or comparable position
- Several years of experience in the area of agile software development
