About this role
A Lead Data Engineer ensures their team's technology stack is fully compliant and managed within Experian security standards and policies. They act as a role model for best practice and high-quality technical output. Their mentoring brings tangible developmental benefit to the engineers they support. They lead and drive measurable technical improvement and innovation within their domain.
Does this sound like you? Interested in finding out more? You should apply.
Desirable, but not essential experience:
Fivetran, Snowplow, or Orchestra for data ingestion and orchestrationData Mesh principles with domain-oriented data ownershipChange Data Capture (CDC) patterns and implementationsReal-time / streaming architectures (e.g. Kafka, Kinesis)MLOps or feature store implementations (e.g. SageMaker, Feast)Migration of legacy data warehouses to modern data platformsFinOps practices and cloud cost optimisation for data platformsSecurity tooling and compliance experience (e.g. Veracode, AquaSec, Rapid7) As Lead Data Engineer, you will combine deep technical expertise with leadership capability. You will drive the migration from legacy data systems to our modern stack, establish engineering standards within your pod, and ensure your team delivers high-quality, reliable data products.
We require a Lead Data Engineer who is highly skilled in:
Snowflake expertise (warehouses, clustering, RBAC, performance tuning)dbt for modular transformations, testing, and CI/CD-enabled data pipelinesPython for data engineering (pandas, orchestration, automation, scripting)Advanced SQL skills (complex transformations, query optimisation)AWS data services experience (S3, Glue, Kinesis, DMS, Redshift)Data pipeline design and architecture across batch and streaming workloadsData quality frameworks (e.g. dbt tests, Great Expectations, or equivalent)Version control and CI/CD practices (Git, GitHub Actions, CodePipeline)Line management and technical mentoring of engineersDriving technical standards and best practices across teamsStrong stakeholder partnership, translating data needs into scalable solutionsCreating onboarding materials, documentation, and self‑service learning resourcesAbility to communicate complex technical concepts to non‑technical audiencesYou will lead a pod of Data Engineers in Hyderabad, reporting to the UK-based Senior Data Engineering Manager. You are accountable for the technical output, professional development, and day-to-day management of your team. You will work asynchronously with UK colleagues and ensure your pod operates as true owners of their domain, not as a support function.
A significant part of your role is enabling other teams to succeed with data. You will build relationships with Marketing, Risk, Analytics, and Data Science teams to understand their challenges and help them navigate the data ecosystem. You will create and maintain onboarding resources, run knowledge-sharing sessions, and ensure teams can self-serve where appropriate. You measure success not just by pipelines delivered, but by the outcomes your customers achieve.
Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here