Das ist der Job
The Senior Data Engineer will design, build, and optimize next-generation Lakehouse data platform.
Darum lohnt es sich
OUR BENEFITS: Remote Office with flexible hybrid working arrangement. This is a hands‑on role focused on transforming complex, legacy datasets into structured, high‑quality data products. KEY RESPONSIBILITIES: Design and implement robust, scalable data ingestion and transformation pipelines using Databricks, PySpark, and distributed processing.
Implement Delta Lake principles, focusing on CDC and schema evolution, and integrate data quality frameworks within CI/CD pipelines. Develop and optimize complex SQL and Python scripts, integrating diverse data sources and supporting data governance solutions.
QUALIFICATIONS: 5+ years of professional experience in data engineering, with strong experience in Databricks, PySpark, and Delta Lake. Expert SQL optimization and Python skills, and hands‑on experience with Airflow or similar workflow orchestration.
Proactive problem‑solver comfortable working with complex, inconsistent data and able to direct AI agents for code generation. Health Insurance, dental care, and family insurance options. Personal Development, sports cards, and social events. #J-18808-Ljbffr
