About this role
Salary: £70,000 - 85,000 per year
Requirements: Current active SC Clearance is mandatory; candidates who are only eligible for SC Clearance cannot be considered.Strong commercial experience with Azure Databricks, Azure Data Factory, and Azure data engineering.Advanced Python skills, including Pandas, and strong SQL expertise.Hands-on experience with Unity Catalog.Experience designing data warehouses, including slowly changing dimensions (SCD) and dimensional modelling.Knowledge of CDC, data ingestion patterns, and governed data platforms.Understanding of data governance, security, and lineage.Experience within regulated or public sector environments is advantageous.Familiarity with Power BI is beneficial but not essential. Responsibilities: Design, build, and optimise Azure data pipelines using Azure Data Factory and Azure Databricks.Develop data ingestion solutions using Change Data Capture and Managed File Transfer.Build canonical data models, conformed dimensions, and fact tables.Deliver curated Gold-layer datasets for reporting, analytics, and AI use cases.Automate data validation and quality assurance processes, replacing manual checks.Configure Unity Catalog, clusters, pipelines, and data contracts.Contribute to data governance, security, lineage, and platform design.Collaborate on solution design, code reviews, testing, and defect resolution. Technologies: AIAzureCloudDatabricksSupportPower BIPythonSQLSecurityUnitypandasGameDev More:
We are offering a 3-month outside IR35 contract with a strong chance of extension based in Leeds, requiring onsite attendance once per week. This is an exciting opportunity for an experienced Data Engineer to support a greenfield Azure cloud data platform as part of a major transformation programme. You will help build a modern platform that integrates complex data from multiple systems, improves data quality, automation, and reporting, and creates a single trusted view of customer information.
last updated 29 week of 2026