About this role
Join an exciting Data Engineering project in the aviation industry, where modern cloud and Big Data technologies are used to support predictive maintenance solutions for aircraft engines.
The project focuses on developing and enhancing a scalable data platform that processes large volumes of operational and technical data. By transforming complex datasets into reliable and accessible information, the platform enables advanced analytics related to engine performance, maintenance needs, and operational efficiency.
As a Data Engineer, you will join an established engineering team and work with technologies such as Microsoft Azure, Databricks, Apache Spark, Python, and SQL. You will be responsible for building and optimizing data pipelines, processing large-scale datasets, and ensuring high quality and availability of data for analytical use cases.
This is a great opportunity for someone who enjoys solving complex data challenges and wants to work on a project where modern Data Engineering has a direct impact on the reliability and maintenance of advanced aviation systems.
Main Tasks
Design, develop, and maintain scalable data pipelines using Azure Databricks, Apache Spark, Python, and SQLProcess and transform large volumes of operational and technical data supporting predictive maintenance and analytical use casesDevelop and optimize ETL/ELT processes for efficient data ingestion, transformation, and storageDesign and implement CI/CD processes for Databricks applications using Azure tooling, including Terraform and Databricks Asset Bundles (DABs)Work with Azure data processing and storage services to build reliable and scalable data solutionsOptimize Spark workloads and improve overall data processing performanceImplement data validation and quality checks to ensure consistency, accuracy, and reliability of datasetsCollaborate with Data Engineers and project stakeholders to translate business and data requirements into technical solutionsContribute to the continuous development, maintenance, and improvement of the existing data platformTroubleshoot data processing issues and improve the stability and performance of data pipelinesPrepare and maintain technical documentation for implemented solutions and data workflows Must-have requirements
Commercial experience in Data EngineeringHands-on experience with DatabricksExperience in implementing CI/CD for Databricks applicationsPractical experience with Microsoft Azure data processing and storage servicesStrong experience with Apache SparkGood knowledge of SQLHands-on development experience with PythonGood understanding of Big Data processing concepts, standards, and toolsExperience working with large-scale data processing pipelines and ETL/ELT processesNice to have
Bachelor's or Master's degree in Computer Science, Data Engineering, Mathematics, or a related technical field We hereby inform you that Inetum Polska sp. z o.o. has implemented an internal reporting (whistleblowing) procedure. The content of the procedure and the possibility to submit an internal report are available at:
https://inetum.whispli.com/speakup?locale=pl