Data Engineer (Ref: 197753)

About Us

Forsyth Barnes have partnered with a leading FMCG company based in Cambridgeshire to scale their data and analytics team

Job Description

ReportingtotheDataManager,you’llhelpdesign,buildandimprovethedataplatformsand infrastructure that support financial and operational insight across the business.

Thisisahands-onrolewhereyou’llworkwithdatafrommultiplesystemsandsources,often with varying levels of structure, consistency and quality. Using technologies including MicrosoftFabric,Azure,Python,SQLandPowerBI,you’llbuildreliable,scalableand maintainable data solutions.

You’ll be involved in significant technology and transformation projects, developing and enhancingdatapipelines,integratingnewdatasources,troubleshootingtechnicalissuesand improving the performance and reliability of existing solutions.

Ifyouenjoysolvingproblems,workingwithmodernclouddatatechnologiesandseeingthe direct impact of your work within a fast-moving business, this is a fantastic opportunity to make a real difference.

Key Responsibilities

• Design, build and operate ELT/ETL data pipelines using Microsoft Fabric

• Design and develop data solutions within a Medallion Architecture (Bronze, Silver and Gold) Develop, optimise and maintain complex SQL queries to support reporting and analytics

• Integrate data from a variety of internal and external sources

• Manage and optimise lakehouses, warehouses and associated storage

• Implement data quality, testing and observability processes to ensure data is accurate, reliable and compliant

• Support data lineage and ensure stakeholders can trust the information available to them

• Enable self-service analytics through well-documented data models and transformation logic

• Monitor performance and proactively identify opportunities to improve our data infrastructure

• Troubleshoot incidents, complete root-cause analysis and deploy effective fixes

• Contribute to CI/CD practices, documentation and engineering standards

• Work closely with colleagues across IT and the wider business to deliver fit-for-purpose data solutions

• Continuously look for opportunities to improve our technology, processes and ways of working

Requirements

• At least 5 years' experience across data engineering, data analytics and/or Business Intelligence

• Proficiency in Python and SQL

• Excellent knowledge of Microsoft Fabric and Power BI Service

• Experience building and operating data pipelines within Azure, including technologies such as ADF, Synapse and Fabric

• Strong understanding of Spark

• Experience working with complex and imperfect datasets

• Experience delivering technology projects within a fast-paced organisation

• Knowledge of version control, Azure DevOps and CI/CD best practices

• Understanding of Infrastructure-as-Code tools such as Terraform

• Knowledge of identity and secrets management and cloud cost optimisation

• Understanding of information management principles, processes and Master Data Management (MDM)

• Experience delivering solutions within appropriate development frameworks and methodologies, with consideration for ongoing supportability