About this role
Responsibilities
- Design and develop scalable data pipelines using Azure Data Factory and Databricks . Implement modern data architectures including Data Lake , Delta Lake , and Lakehouse patterns.
- Manage Databricks Unity Catalog for data sharing, permissions, and robust governance.
- Automate data ingestion, transformation, and deployment processes to enhance platform efficiency.
- Monitor and optimize resource consumption and performance within Azure and Databricks environments.
- Collaborate with data scientists and business stakeholders to industrialize new analytics use cases.
Requirements
- 5+ years of experience in data engineering with a focus on Azure cloud environments.
- You possess deep expertise in Azure Databricks and Unity Catalog , including Lakehouse design and security.
- You bring advanced skills in Spark , PySpark , and Delta Lake for large-scale data processing.
- You have strong proficiency in SQL and Python for data manipulation and platform automation.
- You possess experience with Azure Data Factory , Azure Storage , Azure SQL , and Key Vault . You have knowledge of CI/CD principles and Azure DevOps applied to data engineering.
- You bring familiarity with application integration patterns such as REST API and AMQP . You're proactive and possess an analytical mindset with strong communication skills.
- You are fluent in French or Dutch with professional proficiency in English . Nice to Haves Possession of Microsoft Azure or Databricks certifications.
- Experience with Power BI administration and governance.
- Knowledge of Terraform or Infrastructure as Code . Familiarity with real-time data streaming and Azure Monitor . Basic knowledge of SAP data sources like S/4HANA or BW/4HANA .