About this role
PURPOSE OF THE POSITION
The Data Engineer is responsible for the maintenance and the improvement of all the data flows in the data analytics platform(s). The Data Engineer designs and develops scalable ELT packages and routines from the source systems in order to create information (datasets), defining and building the data pipelines.
The Data Engineer additionally analyzes complex data models and IT Applications, data flows, dependencies and relationships in order to contribute to conceptual physical and logical data models.
Moreover, the Data Engineer acts as architect of the Data & Analytics platform defining the logical data model and the physical data model(s). He/She also keeps up with industry trends and best practices, advising the management on new and improved data engineering strategies.
Main responsibilities
Define the optimal architecture of the Data & Analytics platform enabling the availability and re-usability of all required data for the creation of analytics productsManage and monitor data pipelines to source and transform data to the Data & Analytics Platform(s)Integrate and transform new data sources (internal and external) by creating a full pipeline from ingestion to ETL processDeliver Data Provisioning to operational applications requiring transformation of data from several sourcesOptimize and expand the Data & Analytics platform data flows and data models, supporting in deploying analytics productsDefine and document detailed Data Engineering processes to guarantee efficient building and support of the data & analytics platformAssess the stability, robustness and efficiency of the implemented ELT processes and data pipelines and eventually re-design themGather requirements and write technical specifications documentEnsure and monitor high data quality standards with focus on data consistencyTimely resolve incidents related to data interfaces and ELT processesExpand the current Data & Analytics platform to embed “big data” capability by investigating and sharing best practices Master’s degree in IT / Economics 5-6 years of data engineer experience Fluent EnglishExperience with data modelling (conceptual, logical, physical) and data modelling documentationProfessional experience and conceptual knowledge of building and maintaining physical and logical data models, including data streamingAbility to think beyond technology requirements to build ONE logical Data & Analytics platformExcellent knowledge and proven professional experience with MS Azure and Lakehouse architecture, in-depth knowledge and/or certification in Databricks (Spark)Well structured, analytically thinking and demonstrating the ability to explain processes in a clear and understandable manner to a non-technical audienceSystem management expertise with monitoring, disaster recovery, backup, automated testing, automated schema migration, and continuous deploymentAbility to take ownership and proven strive for excellence