Nomura Overview: Nomura is a financial services group with an integrated global network. By connecting markets East & West, Nomura services the needs of individuals, institutions, corporates and governments through its four business divisions: Wealth Management, Investment Management, Wholesale (Global Markets and Investment Banking), and Banking. Founded in 1925, the firm is built on a tradition of disciplined entrepreneurship, serving clients with creative solutions and considered thought leadership. For further information about Nomura, visit <a href="http://www.nomura.com">www.nomura.com</a>. Nomura Services, India supports the group’s global businesses. With world-class capabilities in trading support, research, information technology, financial control, operations, risk management and legal support, the firm plays a key role in facilitating the group’s global operations across four international regions. At Nomura, creating an inclusive workplace is a priority. Our approach to inclusion encompasses a variety of initiatives, including sensitization campaigns, implementing conducive policies & programs, providing infrastructure support and engaging in community events. Over time, we have made meaningful progress in these areas, and this commitment has been well-recognized across the industry. We are proud recipients of the prestigious Top 10 Employers award by the India Workplace Equality Index (IWEI), IWEI Gold Employer of Choice awards, India CSR Leadership Award 2024 for Holistic Village Development Program and the YUVA Unstoppable Changemaker Awards. Divisional Overview: The Chief Data Office (CDO) plays a key role in defining and implementing the firm's data strategy and is responsible for defining and overseeing effective data, Cloud and AI governance for Nomura to enable data-driven regulatory compliance, data risk mitigation and improved data usability for analytics and AI. It is the central authority overseeing the Business and Corporate functions in complying with data, Cloud and AI governance requirements. What We Offer: <ul style="list-style-type:square;margin-bottom:0.0cm;margin-top:0.0px"> <li style="text-align:justify;margin:0.0cm 0.0cm 0.0cm 0.0px;font-size:11.0pt;font-family:Calibri, sans-serif">We support employee wellbeing by ensuring a sense of purpose and belonging. </li> <li style="text-align:justify;margin:0.0cm 0.0cm 0.0cm 0.0px;font-size:11.0pt;font-family:Calibri, sans-serif">We offer a comprehensive range of wellbeing services which allows employees to get access to the assistance they need at any point in their wellbeing journey. </li> <li style="text-align:justify;margin:0.0cm 0.0cm 0.0cm 0.0px;font-size:11.0pt;font-family:Calibri, sans-serif">Our bespoke benefits support employees and their family’s holistic wellbeing and are inclusive of diverse identities and family structures.</li> </ul> Position Specifications: We are seeking an AI operations professional to design and implement comprehensive AI testing frameworks and operational effectiveness metrics that ensure reliable, safe, and high-performing AI systems. This role combines data science expertise with AI governance to establish measurable standards for AI system performance and safety. This role offers the opportunity to shape the future of AI system reliability and safety while working at the intersection of data science, AI governance, and operational excellence. Role & Responsibilities: Framework Development <ul style="margin-top:0.0cm;margin-bottom:0.0cm" type="disc"> <li style="margin-bottom:8.0pt;line-height:115%;margin-top:0.0cm;margin-right:0.0cm;font-size:12.0pt;font-family:'Times New Roman', serif">Design and build comprehensive AI testing frameworks covering model validation, performance monitoring, and safety assessment</li> <li style="margin-bottom:8.0pt;line-height:115%;margin-top:0.0cm;margin-right:0.0cm;font-size:12.0pt;font-family:'Times New Roman', serif">Develop automated testing pipelines for AI model deployment and continuous monitoring</li> <li style="margin-bottom:8.0pt;line-height:115%;margin-top:0.0cm;margin-right:0.0cm;font-size:12.0pt;font-family:'Times New Roman', serif">Create standardized methodologies for evaluating AI system reliability across different use cases</li> <li style="margin-bottom:8.0pt;line-height:115%;margin-top:0.0cm;margin-right:0.0cm;font-size:12.0pt;font-family:'Times New Roman', serif">Establish benchmarking protocols for comparing AI system performance over time</li> </ul> Metrics Design & Implementation <ul> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Define and implement key performance indicators including</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Model failure rates and error classification systems</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Human intervention frequency and trigger analysis</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Reasoning quality assessment metrics</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Tool utilization success rates and efficiency measures</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Output validation accuracy and consistency scores</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Cross-agent conflict detection and resolution metrics</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Guardrail violation rates and severity classification</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Build real-time monitoring dashboards and alerting systems</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Develop statistical models to analyze AI outputs</li> </ul> AI Governance & Compliance <ul> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Collaborate with compliance teams to ensure testing frameworks meet regulatory requirements</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Document testing methodologies and maintain audit trails for governance purposes</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Establish risk assessment protocols for AI system deployment</li> <li style="line-height:115%;font-size:12.0pt;font-family:'Times New Roman', serif">Create reporting mechanisms for stakeholders and regulatory bodies</li> </ul> Data Analysis & Insights <ul style="margin-top:0.0cm;margin-bottom:0.0cm" type="disc"> <li style="margin-bottom:8.0pt;line-height:115%;margin-top:0.0cm;margin-right:0.0cm;font-size:12.0pt;font-family:'Times New Roman', serif">Analyze large-scale AI system performance data to identify patterns and improvement opportunities</li> <li style="margin-bottom:8.0pt;line-height:115%;margin-top:0.0cm;margin-right:0.0cm;font-size:12.0pt;font-family:'Times New Roman', serif">Conduct root cause analysis on system failures and performance anomalies</li> <li style="margin-bottom:8.0pt;line-height:115%;margin-top:0.0cm;margin-right:0.0cm;font-size:12.0pt;font-family:'Times New Roman', serif">Generate actionable insights from operational metrics to guide system optimization</li> <li style="margin-bottom:8.0pt;line-height:115%;margin-top:0.0cm;margin-right:0.0cm;font-size:12.0pt;font-family:'Times New Roman', serif">Present findings and recommendations to technical and business stakeholders</li> </ul> Mandatory Skill Set : <ul style="margin-top:0.0cm;margin-bottom:0.0cm" type="disc"> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Experience with AI governance frameworks or regulatory compliance</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Background in quality assurance or testing methodologies</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Knowledge of multi-agent systems and AI orchestration platforms</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Experience with real-time monitoring and alerting systems</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Certification in data science or machine learning (e.g., AWS ML, Google Cloud ML)</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Programming: Proficiency in Python or R, with experience in data manipulation libraries (pandas, numpy, scikit-learn)</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Statistical Analysis: Strong foundation in statistical methods, hypothesis testing, and experimental design</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Data Visualization: Experience with visualization tools (Tableau, Power BI, matplotlib, plotly)</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Database Management: SQL proficiency and experience with large-scale data processing</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Cloud Platforms: Familiarity with AWS, Azure, or GCP for data processing and model deployment</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Version Control: Git/GitHub experience for collaborative development</li> </ul> Desired Skill Set : <ul style="margin-top:0.0cm;margin-bottom:0.0cm" type="disc"> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Preferably from financial services background with experience in Investment Banking or Global Markets</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Experience with tools such as Snowflake, Redshift, AWS Bedrock</li> <li style="margin-top:0.0cm;margin-right:0.0cm;margin-bottom:0.0cm;font-size:12.0pt;font-family:Aptos, sans-serif">Experience with Data-Ops, ML-Ops processes, platforms, and methodologies</li> </ul> We are committed to providing equal opportunities throughout employment including in the recruitment, training and development of employees. We prohibit discrimination in the workplace whether on grounds of gender, marital or domestic partnership status, pregnancy, carer’s responsibilities, sexual orientation, gender identity, gender expression, race, color, national or ethnic origins, religious belief, disability or age. *Applying for this role does not amount to a job offer or create an obligation on Nomura to provide a job offer. The expression "Nomura" refers to Nomura Services India Private Limited together with its affiliates. *The benefits are subject to change and will be in accordance with Company’s policies as may be applicable from time to time).

VP - AI Governance (Mumbai, IN) @ Nomura Holdings, inc.

About this role

Ready to apply?