About this role
Salary: £? - ? per year
Requirements: Strong experience with the Elastic Stack (Elasticsearch, Logstash, Kibana)Proven expertise with Apache NiFiExtensive experience designing and building enterprise-scale data pipelinesStrong understanding of secure data architectures and data governanceExperience operating within regulated or security-conscious environmentsAbility to design and deliver end-to-end data engineering solutionsExcellent troubleshooting and performance optimisation skillsDesirable experience with government, defence, or other highly regulated sectorsKnowledge of Apache Kafka, Spark, or HadoopExperience with Docker and KubernetesFamiliarity with monitoring and observability tools such as Prometheus, Grafana, or ELKUnderstanding of machine learning algorithms and their implementationExperience with Infrastructure as Code tools such as Terraform and Ansible Responsibilities: Design, develop, and maintain secure, scalable data pipelines using the Elastic Stack and Apache NiFiBuild and manage data ingestion, transformation, and integration processesEnsure data quality, integrity, security, and compliance with governance standardsCollaborate with data architects and security teams within highly secure environmentsMonitor and manage large-scale, real-time data flows, optimising performance and reliabilityDevelop robust data models to support analytics and reporting capabilitiesCreate dashboards and visualisations using Kibana to drive operational insightsTroubleshoot, debug, and tune data pipelines and platform performanceImplement high availability, backup, and disaster recovery strategiesProduce clear technical documentation, including architecture, workflows, and security protocols Technologies: DockerELKElasticSearchGrafanaHadoopSupportKafkaKibanaKubernetesMachine LearningPrometheusSecuritySparkTerraformAnsible More:
We are seeking an experienced Senior Data Engineer to join a high-profile programme delivering secure, scalable data platforms within a highly regulated environment. This is an onsite role in Worcester, with the option to work a compressed schedule of three extended working days while being compensated for a full five-day week. We offer a 12-month rolling contract, outside IR35, at £70-£75 per hour, with the opportunity to work on complex, mission-critical data platforms and gain long-term contract stability within a high-profile programme.
last updated 29 week of 2026