About this role
Data Engineer Groenlo, Netherlands 32 - 38 hrs € 3.980 - € 5.800 Hybrid What are you going to do? As a Data Engineer you know how to extract data from various silos and convert them into meaningful insights with the help of our dataplatform. You work closely with data analysts that focus on the business context and make analytics insights accessible, for example via dashboards. You will mostly work on our on-premise dataplatform: a GitHub workflows-deployed Airflow instance that runs in Nomad and extracts most of the data from our own internal APIs and databases. The transformation and data validation is done with Python (a.o. pandas, pandera, DuckDB) and the data is written to Ceph S3. This data can be used by the data analysts for EDAs (Exploratory Data Analyses) Jupyter Notebooks in a Docker container on our vm or published to analytics dashboards in PowerBI. You will take on the challenge to make a reliable, safe, yet easy to use system that scales to reach analytics goals of the Healthcare key market. You have an affinity for giving structure to complex, (un)structured, big data and for supporting others in working with data. You enjoy inventing clear processes that facilitate data processing. Your responsibilities Dataplatform You will simplify, maintain and implement new data pipelines. This is done together with your collegue data engineer and the data analysts which are power users of the platform. In the future, you will help integrate, parts of, the platform into the company-wide data infrastructure. Analytics Infrastructure Next to data pipelines, the team conducts notebook-driven EDAs that should be done in a safe and secure environment. You will help enable, improve and optimise the existing processes in our current Analytics Infrastructure approach. Governance With great power comes great responsibility: we work with privacy-sensitive, medical data that is owned by healthcare organisations. A...