About this role
Schiphol Senior 40 uur per week Startdatum op 1 december Interim opdracht 7 Uur geleden KLM Real-time Data Engineer (Medior/Senior) For the cargo division of a major Dutch airline, we are looking for a Medior/Senior Real-time Data Engineer to help develop a modern, real-time data and reporting platform on Google Cloud Platform (GCP). The current operational reporting environment is partly based on legacy SQL/SSRS technology and needs to be replaced. You will contribute to building a scalable, generic real-time data platform that supports critical cargo hub operations, including truck and ULD arrivals, offloads and shipment manifests.
Key Responsibilities
- Develop and maintain real-time data processing and event streaming pipelines.
- Build event refinement and event combination solutions for multiple business use cases.
- Migrate legacy operational reporting to the new real-time data platform.
- Further develop the Build-up Monitor from Proof of Concept to a production-ready MVP.
- Deliver robust, scalable and well-documented streaming solutions.
Requirements
- Medior/Senior experience as a Data Engineer, with a strong focus on real-time data processing.
- Strong programming skills in Java and/or Scala .
- Hands-on experience with Apache Spark, particularly Structured Streaming .
- Experience with Apache Kafka , including topics, producers and consumers.
- Experience with NoSQL databases.
- Hands-on experience with Google Cloud Platform (GCP) .
- Able to work independently, take ownership and solve problems in a complex enterprise environment.
- Strong communication skills and the ability to operate with limited business support.
Nice to Have
- Experience in logistics, aviation or cargo operations.
- Experience with operational reporting environments.
Contract: freelance (ZZP) is not possible. Screening Om de betrouwbaarheid en integriteit van kandidaten te toetsen is screening onderdeel van de sollicitatieproce...