About this role
<p><span style="font-family:Arial, Helvetica, sans-serif"><span style="font-size:11.0px">At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. </span></span></p> <p> </p> <p> </p> <p> </p> <p> </p> <p style="text-align:justify"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong>The opportunity</strong></span></p> <p style="text-align:justify"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong> </strong></span></p> <p style="text-align:justify"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">We are seeking an experienced <strong>GCP Data Engineer</strong> with strong technology and data understanding in GCP engineering space, having proven delivery capability. The candidate will be responsible for building, maintaining, and optimizing data pipelines and data platforms on Google Cloud (Big Query). The role will focus on data ingestion, transformation, orchestration, automation, and analytics enablement for enterprise-scale solutions.</span></p> <p style="text-align:justify"> </p> <p style="text-align:justify"> </p> <p style="text-align:justify"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong>Your Technical responsibilities:</strong></span></p> <p style="text-align:justify"> </p> <ul style="text-align:justify"> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Design and develop scalable ETL/ELT pipelines on GCP</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Build and maintain data ingestion and transformation frameworks using BigQuery and GCP services</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Develop Cloud Functions and automation scripts for data movement and processing</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Create and maintain workflows using Cloud Composer/Airflow</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Implement data reconciliation, validation, and data quality controls</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Troubleshoot pipeline failures and performance issues using monitoring and logging tools</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Support migration of on-premises or legacy workloads to GCP</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Create dashboards, reports, and analytics solutions for business users</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Collaborate with business, architecture, and development teams to deliver data-driven solutions.</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Use Data flow or STS to build pipeline from traditional and cloud source to GCP.</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Good understanding of cloud design considerations and FinOps </span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Proficient in a modern scripting language like Python, Spark and Scala.</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Work with container technology such as Docker, version control systems (Github), build management and CI/CD tools (Concourse, Jenkins)</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong>Data Pipeline Workflows:</strong> Build and maintain data pipelines using tools and services like Dataflow, Dataproc, Apache Beam, Apache Airflow, Cloud Composer, etc. to collect, process, and distribute data.</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong>CI/CD Implementation:</strong> Implement CI/CD pipelines for data applications using services like Cloud Build, Jenkins, or Gitlab. Continuous testing, continuous integration, build, package, and deployment should be automated across multi-cloud environments.</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong>Code Management:</strong> Take charge of source code repositories like GitHub or Bitbucket, ensuring robust version control practices.</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong>Data Security & Compliance:</strong> Implement security best practices. Handle actions such as encryption, managing and securing service accounts, secret management (like with Secret Manager), authentication, access control, and data compliance necessities (like GDPR).</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong>Performance Optimization and Cost Control:</strong> Monitor, debug, troubleshoot, and optimize performance of Dataflow jobs, and other data infrastructure. Implement strategies for optimizing cost across multiple clouds.</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong>Data Lakes and Data Warehouses Management:</strong> Manage BigQuery or other cloud data warehouse solutions and services for Data Lakes.</span></li> </ul> <p style="text-align:justify"> </p> <p style="text-align:justify"> </p> <p style="text-align:justify"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong>Mandatory Requirements (Qualifications)</strong></span></p> <p style="text-align:justify"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><strong><br></strong>We are looking for the candidates with the following: </span></p> <p style="text-align:justify"> </p> <ul style="text-align:justify" type="disc"> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">BE/BTech/MCA with a sound industry experience of 5 to 8 years</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">3–6+ years of Data Engineering experience with hands-on GCP implementation</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Programming Language- Python, SQL, Spark (PySpark)</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Experience in FS domain- preferably asset wealth management</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Experience with CI/CD pipelines and cloud-native development practices.</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Exposure to Apache Spark, Databricks, and modern data engineering frameworks.</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Strong communication skills</span></li> <li style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Google Cloud Certified is add-on</span></li> </ul> <p style="text-align:justify"> </p><p> </p> <p><span style="font-family:Arial, Helvetica, sans-serif"><span style="font-size:11.0px"><b>EY | Building a better working world </b></span></span></p> <p><br> <span style="font-family:Arial, Helvetica, sans-serif"><span style="font-size:11.0px"> <br> EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets. </span></span></p> <p><br> <span style="font-family:Arial, Helvetica, sans-serif"><span style="font-size:11.0px"> <br> Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate. </span></span></p> <p><br> <span style="font-family:Arial, Helvetica, sans-serif"><span style="font-size:11.0px"> <br> Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today. </span></span></p>