About this role
Salary: £? - ? per year
Requirements: 3+ years of experience developing applications in a modern programming environment, preferably Scala/Java and/or Python.Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, and dbt.Working knowledge of SQL and shell scripting.Experience with Docker/k8s and infrastructure-as-code tools such as Terraform, Salt, or similar.Confidence articulating complex technical content to peers and partners across the organization through Technical Design Documents. Responsibilities: Provide data sources that help build the AI/ML user experience.Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow.Provide observability and monitoring using Monte Carlo and Looker, as well as operational tools such as NewRelic and Splunk, to drive reliability, data quality, and robustness.Scope and plan work with product engineering, data science, and the business.Support other teams with tasks related to data tracking, collection, ingestion, quality monitoring, and alerting. Technologies: AIAirflowBigQueryCloudComposerDockerFlinkGCPSupportJavaLookerPythonSQLScalaSparkSplunkTerraformdbtDevOps More:
We are a leading global SaaS organisation offering a 12-month contract for a Software Engineer to work on exciting AI/ML user experience projects. We offer hybrid working, a long contract, and an award-winning work environment. This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, and Google Cloud Platform.
last updated 31 week of 2026