Das ist der Job
Implement business logic, data governance, security, and retention requirements within pipelines.
Darum lohnt es sich
Data Engineer (Modern Data Platforms) Start Date: July/August 2026 Duration: 24 months Workload: 100% Responsibilities Design, develop, and maintain end-to-end data pipelines (ETL/ELT) using Spark, SQL, and related technologies. Collaborate with business stakeholders, product owners, and technical teams to address data needs and issues.
Required Background 5+ years of experience working with modern data technologies. Source Group International Ltd is acting as an Employment Business in relation to this vacancy. #J-18808-Ljbffr Translate business and technical requirements into scalable data solutions and detailed designs.
Contribute to data architecture, ensuring scalable and high-performance system design. Support continuous delivery through effective governance, transparency, and communication. Stay up to date with emerging data technologies and support proof-of-concept initiatives.
Strong experience building data ingestion pipelines for data warehouse, data lake, or lakehouse architectures. Hands‑on expertise with big data and open‑source tools (e.g., Spark, Hadoop, Hive, Kafka, dbt, ELK), ideally in a Cloudera environment. Proficiency in Python and strong SQL skills.
Solid understanding of data modelling, scalable system design, and data engineering best practices. Experience in financial services (e.g., trade lifecycle, risk management). Familiarity with lakehouse technologies such as Apache Iceberg. Experience with relational and NoSQL databases (e.g., Postgres, SQL Server, Cassandra).
Exposure to workflow orchestration (Airflow, NiFi), streaming (Kafka, Spark Streaming), and CI/CD pipelines. Knowledge of Agile methodologies and testing practices.
Experience with cloud platforms (Databricks, Snowflake, Azure Synapse) - nice-to-have Understanding of microservices and APIs (REST/SOAP) - nice-to-have Exposure to .NET/C# - nice-to-have You bring strong communication skills We believe in equal opportunity for all and actively encourage applications from diverse backgrounds, experiences, and perspectives.
