RQ00822 - Systems Testing/QA Specialist - Senior

6 Months contract (282 Business Days)

Hybrid - Metro Hall, 55 John Street Toronto

Must-haves

• Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases.
• Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
• Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing?across web-based, mobile, and cloud platforms.
• Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc.
• Experienced in SAP or Salesforce

Description

Qualifications

• The Quality Assurance Specialist (QA lead) is responsible for performing application testing tasks and Quality Assurance activities including Functional Testing, Automation Testing, and various AI testing as described below.
• The Quality Assurance Specialist (QA lead) will participate in planning and estimating the activities required to test the new solutions and enhanced applications. He/She will participate in the development of Master Test Plans, Test
• Cases, Test Scripts, Test Completion Reports, etc. while providing advice to business users for the development of Test Cases for User Acceptance Test.
• Executing the tests as required, performing issue tracking and resolution.
• The Quality Assurance Specialist (QA Lead) plays a critical role in ensuring the delivery of high-quality software solutions by designing, executing, and managing testing activities throughout the software development lifecycle. The QA Specialist will work collaboratively with cross-functional teams to validate system functionality, performance, and usability, and ensure alignment with business requirements and quality standards.

Key Responsibilities

Quality Assurance Leadership

• Lead testing efforts for assigned projects, including planning, coordination, execution and oversight of QA activities.
• Assess risks to quality based on verification and validation results and provide recommendations for mitigation.
• Implement and maintain quality processes that support development and production change management.

Test Design & Planning

• Design comprehensive manual and automated testing processes, including test plans, test cases, and test scripts.
• Develop functional, system, regression, integration, load, and performance test scenarios based on project requirements.
• Collaborate with development leads and business analysts to design and create test data to support test execution.

Test Execution & Management

Perform various types of testing manually and/or using automation tools, including:

• Functional Testing
• Regression Testing
• Integration Testing
• Usability/Accessibility Testing
• Performance Testing
• Perform the following types of AI testing activities:
• Functional AI Testing
• Response accuracy
• Hallucination testing
• Prompt testing
• AI-Security and privacy testing (prompt injection)
• AI-Safety Testing (inappropriate behaviours)
• Execute test cycles, monitor progress, and manage defect resolution and issue tracking.
• Maintain detailed records of test