We are currently looking for a Senior Data Engineer to assist in developing intelligent solutions enabling our customers to accelerate discovery, acquire clinical insights, and address R&D challenges. The schedule is within the Central European Time.
Location:
Quantori is an international team: we have colleagues who work not only from office but also remotely from all over the world.
Responsibilities:
- Review mapping definition with data analysts
- Contribute with other data scientists on mapping definition for transformation pipelines
- Contribute to mapping function development and unit testing of these functions
- Contribute to mapping configurations
- Define the design of quality control pipelines, ensuring mapping accuracy and alignment with analytical expectations
- Review and maintain the quality control pipelines with the Data Analyst, Data Domain Lead and Data Governance Lead
- Implement or configure the appropriate tools for the approved quality control pipelines
- Provide the guidelines for introducing Machine Learning and LLM in the transformation pipelines
What we expect:
- 10+ years of experience in Data Engineering
- Strong familiarity with the Databricks platform (including Unity Catalog)
- Ability to write robust code with Python
- Proficiency with Spark (PySpark)
- Knowledge of cloud platforms: AWS
- Experience in implementing ML and LLM in production data pipelines
- Ability to collaborate closely with Central European time zone
Nice to have:
- Knowledge of Lakehouse concept including experience using Delta Lake optimized storage layer
- Familiarity with SODA is a plus
We offer:
- Healthcare benefits: medical insurance and paid sick leave
- Continuous education, mentoring, and professional development programs
- A team with an excellent tech expertise
- Certifications paid by the company
