About this role
Salary: £90,000 - 120,000 per year
Requirements
- 5+ years of hands-on Databricks platform experience
- Extensive Azure Databricks architecture experience
- Expert-level knowledge of PySpark, Spark SQL and Python
- Deep understanding of Apache Spark processing architecture
- Extensive Delta Lake and Lakehouse architecture experience
- Strong experience designing Medallion Architecture
- Expert knowledge of Unity Catalog, governance, permissions and data lineage
- Experience designing Databricks workspaces, clusters, compute policies and networking
- Knowledge of private endpoints, managed identities, Key Vault and secure connectivity
- Experience with Azure Data Lake Storage Gen2, Azure Data Factory and Azure services
- Extensive experience delivering enterprise data architectures
- Understanding of UK Government security principles and data governance requirements
- Experience architecting platforms that handle sensitive and restricted government data
- Knowledge of UK GDPR, the Data Protection Act 2018 and relevant government security standards
- Experience producing architecture documentation, HLDs, LLDs and technical design authority materials
- Experience working with public sector enterprise architecture and governance boards
- Must be eligible and willing to undergo SC clearance
- Previous experience working on sensitive government projects is advantageous
Responsibilities
- Own the end-to-end Databricks solution architecture
- Define scalable and secure Lakehouse architecture
- Establish engineering and architecture standards
- Design data ingestion, transformation and consumption patterns
- Define Unity Catalog and enterprise data governance models
- Provide technical direction to data engineering teams
Technologies
- Architect
- Azure
- Databricks
- Python
- PySpark
- SQL
- Security
- Spark
- Unity
- Cloud
- GameDev
More
We are recruiting a Databricks Solution Architect for a consultancy client to define and deliver enterprise-scale data platform architectures using Azure Databricks. This is a technical architecture role supporting UK Public Sector organisations, requiring work across architecture design, technical implementation and engineering leadership.
last updated 47 week of 2026