Senior Specialist - Data Engineering

Darum lohnt es sich

Your Role Key responsibilities in your new role Collaborate closely with the reporting team, data scientists, product owners, and domain experts to design, develop, and maintain scalable data pipelines using an agile development methodology.

Collaborate with cross-functional teams to address requirements for data preparation and process Build efficient and reusable pipelines to ingest, process, and manage large-scale structured and unstructured datasets using cloud infrastructure, while ensuring compliance with data governance, lineage, and monitoring standards.

Work effectively with diverse data sources, including structured datasets (e.g., RDBMS, Hive, Impala) and semi-structured datasets (e.g., JSON, XML, logs). Leverage cloud platforms and tools such as AWS, Dataiku, and Hadoop to architect and implement scalable, fault-tolerant data solutions.

Automate and optimize ETL workflows to streamline data integration and transformation processes for enterprise-scale reporting and AI solutions. Develop and maintain a strong foundation in software engineering practices, including CI/CD pipelines, version control tools (e.g., Git), and advanced scripting with Python or PySpark (preferably).

Utilize containerization and orchestration systems such as Jenkins, Dataiku, and Git to deploy, manage, and monitor scalable data solutions. Monitor, troubleshoot, and support operational data pipelines to ensure they meet user requirements, implementing bug fixes and necessary changes promptly.