smartrecruiters

IT engineer Data & Analytics DevOps @ Continental

Bengaluru, KA, inOnsiteFull-timePosted 10 days ago

Opens on smartrecruiters

About this role

Ensure stable, scalable, and secure operation of the Azure-based Data & Analytics platform, including Databricks, Azure-native components, Power BI, and CI/CD infrastructureOffload operational workload from platform architects by taking ownership of infrastructure, deployment automation, and pipeline reliabilityEnable smooth execution and troubleshooting of data pipelines written in Scala and PySpark, including hybrid integration scenarios such as Power BI with gateway infrastructureReports to: Head of Data & Analytics IT Competence CenterCollaborates with: Platform Architects, Data Engineers, ML Engineers, Power BI DevelopersGeography: Global (stakeholders in Germany, India, Manila)Operational Scope: Azure services, Databricks workspaces, CI/CD toolchains, Power BI service (incl. gateways), and Spark-based data pipelines

Main Tasks

- Operate and optimize Azure resources (ADF, Key Vault, Monitor, Event Hub)

- Administer Databricks workspace access and cluster configs

- Apply Infrastructure-as-Code (Terraform/Bicep)

- Manage CI/CD pipelines for Scala and PySpark-based pipelines

- Integrate build steps (e.g., Maven/SBT, Python wheels) into automated deployments

- Enforce DevSecOps and IaC standards

- Monitor Spark job execution, analyze failures and stage-level issues using Spark UI and logs

- Configure alerts, metrics, and dashboards for pipelines and infrastructure

- Lead post-incident reviews and reliability improvements

- Administer Power BI tenant configuration, workspace access, and usage monitoring

- Operate and monitor on-premises or VM-hosted enterprise gateways

- Troubleshoot dataset refreshes and hybrid data integration

- Support runtime execution of production pipelines and ensure SLA adherence

- Collaborate with engineers to resolve Spark performance issues or deployment errors

- Participate in schema evolution and environment transitions

- Enforce platform policies (tagging, RBAC, audit logging)

- Maintain credential and secrets security using Key Vault and managed identity

- Conduct audits across Azure, Databricks, and Power BI environments

Education / Certification:

Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or related field.

Preferred: Azure DevOps Engineer Expert, Power BI Admin, or Databricks Admin certificationsProfessional Experience:

Minimum 5 years in cloud platform engineering, DevOps, or SRE roles within data or analytics platforms

Hands-on experience with Spark (Databricks), PySpark, and CI/CD for JVM-based data applicationsProject or Process Experience:

Proven ability to deploy and operate complex data pipeline ecosystems using Scala and PySpark

Experience in managing Power BI service in enterprise setups, including hybrid gateway environmentsLeadership Experience:

No formal people leadership required; expected to lead through technical authority and cross-team collaborationIntercultural / International Experience:

Experience working in distributed teams across time zones and cultures; strong communication skills and resilience The well-being of our employees is important to us. That's why we offer exciting career prospects and support you in achieving a good work-life balance with additional benefits such as:

Training opportunitiesMobile and flexible working modelsSabbaticalsand much more...

Sounds interesting for you? Click here to find out more.

Diversity, Inclusion & Belonging are important to us and make our company strong and successful. We offer equal opportunities to everyone - regardless of age, gender, nationality, cultural background, disability, religion, ideology or sexual orientation.

Ready to drive with Continental? Take the first step and fill in the online application.

Skills

Information TechnologyMid-Senior LevelInformation Technology And Services

Ready to apply?

Install the ResuMinder extension and we'll auto-fill the application in seconds — no rewriting.

Get the extension →