About this role
Salary: £? - ? per year
Requirements: Strong AWS cloud platform migration experienceStrong Terraform and Infrastructure as Code (IaC) skillsIn-depth data engineering experienceExperience with Python, PySpark and SQLExperience with data pipeline development, ETL/ELT design, data modelling, data quality and data validationExperience with AWS cloud data platforms, including S3 and IAMUnderstanding of CI/CD concepts, DevOps principles and Agile deliveryGovernment, public sector or similar large-scale transformation experience strongly preferredActive SC clearance or full eligibility to undergo the SC security clearance processAdvantageous experience with Databricks, Palantir Foundry, Foundry Pipeline Builder, Ontology concepts, Delta Lake, Secure Data Environment (SDE) and NHS/healthcare data Responsibilities: Support the delivery of large-scale data processing solutionsSupport a major data platform modernisation programmeMigrate data pipelines, notebooks and data workloads from a legacy Databricks environment to modern AWS cloud-based data platformsDevelop and maintain Terraform code to support data platform deploymentsSupport deployment of data platform components, jobs, permissions and environment configurationsAnalyse current data engineering solutions and identify data migration requirementsOnboard datasets, users and workloads onto the target platform Technologies: AWSCI/CDCloudDatabricksDevOpsETLIAMSupportPythonPySparkSQLSecurityTerraform More:
We are a leading global IT transformation business specialising in large-scale Government projects. This is a 6-month rolling contract for a Data Platform Engineer based in London with a hybrid working model, typically 3-4 days remote and 1-2 days in the office, plus occasional travel to our Leeds office. The role offers the opportunity to work on a major data platform modernisation programme and contribute to the migration of critical data assets into our AWS cloud environment.
last updated 29 week of 2026