About this role
Salary: £52,000 - 92,000 per year
Requirements: Experience delivering and deploying production-ready data processing solutions using BigQuery, Pub/Sub, Dataflow and DataprocExperience developing end-to-end solutions using batch and streaming frameworks such as Apache Spark and Apache BeamExpert understanding of when to use a range of data storage technologies including relational/non-relational, document, row-based/columnar data stores, data warehousing and data lakesExpert understanding of data pipeline patterns and approaches such as event-driven architectures, ETL/ELT, stream processing and data visualisationExperience working with business owners to translate business requirements into technical specifications and solution designs that satisfy the data requirements of the businessExperience working with metadata management products such as Cloud Data Catalog and Collibra and data governance tools like DataplexExperience in developing solutions on GCP using cloud-native principles and patternsExperience building data quality alerting and data quarantine solutions to ensure downstream datasets can be trustedExperience implementing CI/CD pipelines using techniques including git code control/branching, automated tests and automated deploymentsComfortable working in an Agile team using Scrum or Kanban methodologiesExperience of working on migrations of enterprise-scale data platforms including Hadoop and traditional data warehousesAn understanding of machine learning model development lifecycle, feature engineering, training and testingGood understanding or hands-on experience of KafkaExperience as a DBA or developer on RDBMS such as PostgreSQL, MySQL, Oracle or SQL ServerExperience designing data applications to meet non-functional requirements such as performance and availabilityAbility to clearly communicate with clients and peers in written and workshop contextsAbility to explain technical concepts to non-technical audiences at all levels of an organisationAbility to influence and persuade senior and specialist client stakeholders across multiple organisational boundaries without direct authorityConfidence in problem solving and troubleshootingWillingness to share specialist knowledge, ideas and solutionsCommitment to continuous learning and coaching others Responsibilities: Lead a team or the solution delivery effort as a subject matter expert in Google Cloud data processing and management capabilitiesProvide technical support and lead engineering efforts across one or multiple teamsDefine the end-to-end software development lifecycle in line with modern best practicesDevelop robust data processing jobs using Google Cloud Dataflow, Dataproc and BigQueryDesign and deliver automated data pipelines using orchestration tools such as Cloud ComposerDesign end-to-end solutions and contribute to architecture discussions beyond data processingOwn the development process for the team, putting robust methods and patterns in place across architecture, scope, code quality and deploymentsShape team behaviour for specifications, acceptance criteria, estimating stories, sprint planning and documentationDefine and evolve our data engineering standards and practicesLead and influence technical discussions with client stakeholders to secure collective buy-inCoach and mentor team members and build their expertise and understanding Technologies: BigQueryCI/CDCloudComposerETLExcelGCPGitHadoopSupportKafkaKanbanMachine LearningMySQLNetworkOraclePostgreSQLSQLSparkDevOps More:
We are an innovation and transformation consultancy that believes in the power of ingenuity to build a positive human future in a technology-driven world. Our diverse teams of experts combine innovative thinking with breakthrough technologies to progress further, faster. With a global network of FTSE 100 and Fortune 500 clients, we offer unrivalled opportunities for growth and the freedom to excel. We combine strategies, technologies and innovation to turn complexity into opportunity and deliver enduring results, helping build a lasting career. We offer a benefits package that includes private medical insurance, an interest-free season ticket loan, 25 days annual leave with the opportunity to buy 5 additional days, a company pension scheme, an annual performance-based bonus, life and income protection insurance, tax-efficient benefits such as cycle to work, give as you earn and childcare benefits, and voluntary benefits including dental, critical illness and spouse/partner life assurance. We are committed to building an inclusive and supportive culture where diversity thrives, so all our people can excel.
last updated 40 week of 2026