About this role
<p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><strong> <span>About the Role</span></strong></span></p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">We are seeking an AI Operations Engineer to help support and optimize our next-generation AI platform focused on compliance, surveillance, and intelligent workflow automation.This role will work closely with AI engineers, product managers, and domain experts to evaluate AI outputs, manage training and evaluation datasets, improve prompts and agent behaviors, and help operationalize LLM-powered systems across the platform.</span></p> <p> </p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><strong><span>** Work Location: Durham, NC/Hybrid-2 days in office**</span></strong></span></p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">The ideal candidate is detail-oriented, analytical, and excited about working hands-on with modern AI technologies including agents, MCP servers, vector search, RAG pipelines, document/media processing, and large language models.</span></p> <p> </p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><strong>Responsibilities</strong></span></p> <ul> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">Test and evaluate AI agents, prompts, and workflows across multiple use cases</span></li> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">Create, maintain, and curate labeled datasets for AI evaluation and tuning</span></li> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">Review AI-generated outputs for quality, accuracy, safety, and consistency</span></li> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">Update and optimize prompts, agent instructions, and AI “skills”</span></li> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">Help improve retrieval quality for vector search and RAG pipelines</span></li> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">Assist with evaluation frameworks and benchmark creation for LLM systems</span></li> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">Work with engineering teams to validate MCP connectors and integrations</span></li> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">Analyze model failures, hallucinations, and edge cases to improve system performance</span></li> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">Participate in human-in-the-loop review workflows for AI-generated content</span></li> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">Document testing procedures, findings, and recommended improvements</span></li> <li style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><span>Collaborate with compliance and domain experts to refine AI behaviors and detection logic</span> </span></li> </ul> <p> </p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><strong>What working at ACA offers: </strong></span></p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">We offer a competitive compensation package where you’ll be rewarded based on your performance and recognized for the value you bring to our business. Our Total Rewards package includes medical and dental coverage and 401(k) plans, and a wide range of paid time off options as well as a flexible work environment. You’ll also be granted time off for designated ACA Paid Holidays, Summer Fridays, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. We also offer unique benefits such as Student Debt Forgiveness and Pet Insurance. </span></p> <p> </p> <p> </p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><strong>About ACA: </strong></span></p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">ACA Group is the leading governance, risk, and compliance (GRC) advisor in financial services. We empower our clients to reimagine GRC and protect and grow their business. Our innovative approach integrates consulting, managed services, and our ComplianceAlpha® technology platform with the specialized expertise of former regulators and practitioners and our deep understanding of the global regulatory landscape. </span></p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"> </span></p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><strong>What we commit to: </strong></span></p> <p><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif">ACA is firmly committed to a policy of nondiscrimination, which applies to recruiting, hiring, placement, promotions, training, discipline, terminations, layoffs, transfers, leaves of absence, compensation and all other terms and conditions of employment. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law. </span></p> <p> </p> <p> </p> <div><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><strong>VISA SPONSORSHIP IS NOT AVAILABLE FOR THIS ROLE</strong></span><br><span style="font-size:14.0pt;font-family:arial, helvetica, sans-serif"><strong>C2C IS NOT AVAILABLE — W‑2 ONLY</strong></span></div>