Senior Data Engineer (Databricks)

About the role

We are looking for a Senior Data Engineer with strong Databricks experience to build and optimize modern data platforms. You will develop scalable ETL/ELT pipelines, process large datasets and contribute to the evolution of cloud-native Data Engineering solutions.

Responsibilities:

• Design, develop and maintain scalable ETL/ELT pipelines
• Build reliable batch and streaming data processing solutions
• Develop data pipelines using Databricks and Apache Spark
• Optimize Spark jobs and improve platform performance
• Work with Delta Lake and Medallion Architecture
• Build and maintain data models for analytics and reporting
• Ensure data quality, monitoring and observability
• Collaborate with Architects, Data Scientists and Analytics teams
• Participate in code reviews and technical improvements
• Contribute to CI/CD processes and engineering best practices

Requirements:

• 5+ years of experience in Data Engineering
• 2+ years of commercial experience with Databricks
• Strong knowledge of PySpark and Spark SQL
• Excellent SQL skills
• Strong Python programming skills
• Experience building ETL/ELT pipelines
• Experience working with Delta Lake
• Good understanding of Medallion Architecture
• Experience with cloud environments (Azure, AWS or GCP)
• Experience with Git and CI/CD
• Understanding of data modelling principles
• Good communication skills
• Fluent English - C1

Nice to have:

• Unity Catalog experience
• dbt
• Kafka or Structured Streaming
• Airflow or Databricks Workflows
• Databricks certification
• Experience with performance tuning and cost optimization