About this role
RQ00822 - Systems Testing/QA Specialist - Senior 6 Months contract (282 Business Days) Hybrid - Metro Hall, 55 John Street Toronto
Must-haves: • Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases. • Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms. • Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing?across web-based, mobile, and cloud platforms. • Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc. • Experienced in SAP or Salesforce Description Qualifications: • The Quality Assurance Specialist (QA lead) is responsible for performing application testing tasks and Quality Assurance activities including Functional Testing, Automation Testing, and various AI testing as described below. • The Quality Assurance Specialist (QA lead) will participate in planning and estimating the activities required to test the new solutions and enhanced applications. He/She will participate in the development of Master Test Plans, Test • Cases, Test Scripts, Test Completion Reports, etc. while providing advice to business users for the development of Test Cases for User Acceptance Test. • Executing the tests as required, performing issue tracking and resolution. • The Quality Assurance Specialist (QA Lead) plays a critical role in ensuring the delivery of high-quality software solutions by designing, executing, and managing testing activities throughout the software development lifecycle. The QA Specialist will work collaboratively with cross-functional teams to validate system functionality, performance, and usability, and ensure alignment with business requirements and quality standards. Key Responsibilities: Quality Assurance Leadership • Lead testing efforts for assigned projects, including planning, coordination, execution and oversight of QA activities. • Assess risks to quality based on verification and validation results and provide recommendations for mitigation. • Implement and maintain quality processes that support development and production change management. Test Design & Planning • Design comprehensive manual and automated testing processes, including test plans, test cases, and test scripts. • Develop functional, system, regression, integration, load, and performance test scenarios based on project requirements. • Collaborate with development leads and business analysts to design and create test data to support test execution. Test Execution & Management Perform various types of testing manually and/or using automation tools, including: • Functional Testing • Regression Testing • Integration Testing • Usability/Accessibility Testing • Performance Testing • Perform the following types of AI testing activities: • Functional AI Testing • Response accuracy • Hallucination testing • Prompt testing • AI-Security and privacy testing (prompt injection) • AI-Safety Testing (inappropriate behaviours) • Execute test cycles, monitor progress, and manage defect resolution and issue tracking. • Maintain detailed records of test