About this role
AI Quality Engineer at Rootly. Location: Toronto, Ontario, Canada. Role: designing tests, evaluating outputs, identifying failures Requirements: 5+ years in QA/product operations/AI evaluation, hands-on experience testing LLM/agentic AI, strong prompt engineering instincts, Python scripting experience a plus, excellent analytical and communication skills. Category: Quality Assurance Seniority: Senior Level Tools: LLM, LangSmith, PromptFlow, Braintrust, Python, Playwright Commitment: Full Time Workplace: Hybrid Languages: English