About this role
EY GDS Consulting – Senior Data Engineer (Databricks & Azure) The Opportunity EY GDS is seeking a Senior Data Engineer with strong expertise in Databricks, Azure, Python, and SQL to join our growing Data Engineering team. You will help deliver enterprise-scale data modernization and cloud transformation programs, building modern Lakehouse solutions that enable analytics, AI, and business intelligence for global clients. This role offers the opportunity to work with cutting-edge cloud and data technologies while collaborating with cross-functional teams across Data, AI, Analytics, and Cloud.
Key Responsibilities
- Design, build, and optimize data pipelines using Databricks, PySpark, Python, and SQL.
- Develop scalable ETL/ELT solutions and Lakehouse architectures.
- Implement solutions using Delta Lake, Unity Catalog, Databricks Workflows, and Structured Streaming.
- Develop and support Azure-based data platforms leveraging ADF and ADLS Gen2.
- Optimize Spark workloads for performance, scalability, and cost efficiency.
- Implement CI/CD, DataOps, and engineering best practices.
- Collaborate with business and technical stakeholders to deliver high-quality data solutions.
- Support data governance, quality, and security initiatives.
- Mentor junior engineers and contribute to capability development.
- To Qualify for the Role, You Must Have 5+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Advanced proficiency in Python and SQL.
- Experience developing scalable data pipelines using PySpark and Databricks.
- Experience with: Delta Lake Unity Catalog Databricks Workflows Structured Streaming Experience with Azure Data Factory (ADF) and Azure Data Lake Storage Gen2 (ADLS Gen2).
- Strong understanding of Data Modeling, ETL/ELT, and Data Warehousing concepts.
- Experience with CI/CD using Azure DevOps, GitHub, or Git.
- Experience optimizing Spark workloads in large-scale environments.
- Excellent communication, problem-solving, and stakeholder management skills.
- Preferred Skills Databricks Certified Data Engineer Associate or Professional.
- Microsoft Azure Data Engineer Associate (DP-203).
- Experience with Microsoft Fabric, Snowflake, AWS, or GCP.
- Familiarity with AI/ML workloads on Databricks.
- Knowledge of Terraform, DevOps, and DataOps practices.
- Exposure to Generative AI and modern AI platforms.
- What We Look For Strong engineering fundamentals and passion for modern data platforms.
- Ability to solve complex business problems using data.
- Ownership, accountability, and continuous learning mindset.
- Effective collaboration across global and cross-functional teams.
What We Offer
- Enterprise-scale Data & AI transformation projects.
- Exposure to the latest Databricks, Azure, AI, and Analytics technologies.
- Continuous learning and certification opportunities.
- A collaborative, inclusive, and high-performing culture.
- Clear career growth within EY GDS Consulting.
- Join EY GDS and help shape the future of Data, Analytics, and AI through modern cloud and Lakehouse solutions.
About EY As a global leader in Assurance, Tax, Strategy & transactions, and Consulting services, we’re using the finance products, expertise, and systems we’ve developed to build a better working world. That starts with a culture that believes in giving you the training, opportunities and creative freedom to make things better. Whenever you join, however long you stay, the exceptional EY experience lasts a lifetime. And with a commitment to hiring and developing the most passionate people, we’ll make our ambition to be the best employer by 2020 a reality. If you can confidently demonstrate that you meet the criteria above, please contact us as soon as possible. Join us in building a better working world.