About this role
Salary: £130,000 - 149,500 per year
Requirements: At least two years of recent, hands-on Databricks experienceEvidence of delivering Databricks solutions into production environmentsAn active Databricks Data Engineering, Machine Learning or Generative AI certificationStrong experience implementing Medallion Architecture across Bronze, Silver and Gold layersHands-on Unity Catalog experience covering catalog design, access controls, lineage and secure data sharingExperience developing Declarative Pipelines with Expectations, including failure handling and observabilityKnowledge of Auto Loader, Lakeflow Connect and batch, streaming or incremental ingestion patternsProduction-level PySpark and SQL development skillsStrong knowledge of Delta Lake, including MERGE, schema evolution, OPTIMIZE, ZORDER and VACUUMExperience with Databricks Workflows, orchestration and CI/CDUnderstanding of monitoring, alerting, replay, backfill and operational support strategiesAbility to mentor engineers and act as the technical escalation pointExperience with RBAC, data masking, Photon, cluster optimisation or cost management would be beneficialExposure to Mosaic AI, Vector Search, model serving, RAG or Lakebase would be advantageous Responsibilities: Lead the delivery of a modern enterprise data platform for a leading financial services organisationTake technical ownership of Databricks lakehouse solutions, covering ingestion through to curated serving layersImplement Medallion Architecture, Unity Catalog, Declarative Pipelines and scalable Databricks-native ingestion patternsMentor engineers and drive production-quality deliveryShape engineering standards, reusable patterns and delivery practices Technologies: AICI/CDDatabricksSupportMachine LearningModel ServingPySparkRAGRBACSQLUnityGameDev More:
We are offering up to £575 per day inside IR35 on an initial 6-month contract with potential extension. The role is hybrid with three days per week on-site in London and an ASAP start. We are providing technical leadership of a strategic Databricks implementation, with the opportunity to shape engineering standards, reusable patterns and delivery practices for a leading financial services organisation.
last updated 38 week of 2026