About this role
Salary: £? - ? per year
Requirements: Strong Spark and PySpark engineering experienceExperience developing and modernising large-scale data pipelinesStrong Python skills and software engineering fundamentalsExperience with performance, scalability, and workload optimisationCloud data engineering experience, ideally on AWSExperience with CI/CD and modern engineering practicesExperience working in complex, enterprise-scale data environmentsSenior or Lead-level data engineering experienceAbility to use AI tools to accelerate development while maintaining strong engineering judgement Responsibilities: Build, modernise, and optimise data workloads in a large-scale, complex environmentWork hands-on across engineering rather than overseeing from a distanceDevelop and modernise large-scale data pipelinesApply performance and scalability improvements to data workloadsUse AI to support the development lifecycle while reviewing and correcting AI-generated code where neededDeliver robust engineering solutions that scale properly Technologies: AIAWSCI/CDCloudSupportPythonPySparkSpark More:
We are a major UK organisation making significant investment across our Data and AI estate. This is a Senior or Lead Data Engineer contract role based in London on a hybrid arrangement with three days onsite. The initial contract duration is six months, and the role is inside IR35. We are looking for a hands-on engineer who enjoys tackling genuinely large-scale data challenges and working in a modern, complex enterprise environment.
last updated 33 week of 2026