About this role
The Senior Quality Auditor serves as a specialist who becomes the organization's deepest expert on 1-2 complex machine learning data workflows while maintaining hands-on audit execution. This role within the Machine Learning Data Operations job family leads Quality Audit Design (QuAD) teams for high-complexity workflows, handles the most ambiguous audit scenarios, and generates workflow-specific quality analysis that drives customer insights and workflow optimization. Key job responsibilities Workflow Expertise Development - Become the organization's deepest expert on 1-2 assigned complex workflows through intensive pilot participation and continuous learning - Participate in workflow pilots as an annotator to build foundational knowledge before production begins - Develop comprehensive understanding of workflow conventions, edge cases, and quality requirements Team Leadership - Lead QuAD teams of 3-5 Quality Auditors for Template 2 (High-Engagement Support) workflows - Provide day-to-day leadership and make real-time quality decisions during iteration phases - Handle escalations from team members and serve as the go-to expert for workflow-specific questions - Mentor and develop Quality Auditor team members through coaching, feedback, and knowledge sharing Audit Execution - Execute audits on the most ambiguous and complex scenarios, reducing escalations to Quality Specialists - Maintain 60-70% hands-on audit execution to preserve expertise required for real-time decision-making - Validate team audit decisions and ensure consistency across QuAD team members - Support Template 1 workflows by auditing high-complexity scenarios requiring specialized judgment Analysis & Insights - Generate workflow-specific deep dives and thematic analysis providing insights beyond conventions adherence scores - Identify error patterns, convention evolution, and areas of ambiguity within assigned workflows - Provide actionable recommendations for workflow optimization and quality improvement - Partner with DSLs and customers on workflow-specific quality insights Strategic Collaboration - Provide input to audit strategy design led by Quality Specialist I - Collaborate with Quality Specialists on cross-workflow patterns and tactical improvements - Participate in workflow design discussions with customers and stakeholders - Support new-tool onboarding for operationalized and bootstrapped interfaces - Track record of generating actionable insights from quality data.