Systems Testing/QA Specialist – Senior
- Pay Rate: Flexible- Hybrid
- Location: Toronto, Ontario
- Contract Length: 6 Months
We at Raise are hiring right now for one of our Clients. If you’re interested, apply below for your chance to join a great place to work.
Responsibilities:
· Quality Assurance Leadership
o Lead testing efforts for assigned projects, including planning, coordination, execution and oversight of QA activities.
o Assess risks to quality based on verification and validation results and provide recommendations for mitigation.
o Implement and maintain quality processes that support development and production change management.
· Test Design & Planning
o Design comprehensive manual and automated testing processes, including test plans, test cases, and test scripts.
o Develop functional, system, regression, integration, load, and performance test scenarios based on project requirements.
o Collaborate with development leads and business analysts to design and create test data to support test execution.
· Test Execution & Management
o Perform various types of testing manually and/or using automation tools, including:
§ Functional Testing
§ Regression Testing
§ Integration Testing
§ Usability/Accessibility Testing
§ Performance Testing
o Perform the following types of AI testing activities:
§ Functional AI Testing
§ Response accuracy
§ Hallucination testing
§ Prompt testing
§ AI-Security and privacy testing (prompt injection)
§ AI-Safety Testing (inappropriate behaviours)
o Execute test cycles, monitor progress, and manage defect resolution and issue tracking.
o Maintain detailed records of test results and discrepancies using designated QA tools.
· Coordination & Collaboration
o Work closely with project managers, implementation team, system administrators, architects, vendors (as needed) and database administrators to ensure testing activities are aligned with project timelines and technical requirements.
o Lead and assist business users in conducting User Acceptance Testing (UAT), providing guidance and support as needed.
· Reporting & Communication
o Manage the full-cycle process for documenting and communicating test discrepancies and defects to appropriate stakeholders.
o Provide regular updates on testing progress, issues, and outcomes to project teams and management
Develop and build a Test Completion Report summarizing all testing activities and results for Gating purposes
Assignment Duties:
· Post-secondary degree in Computer Science, Electronic Engineering, or a related discipline.
· Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
· Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases.
· Experience using AI tools to increase testing coverage, negative testing, regression testing with knowledge of AI-assisted automation for CI/CD pipelines.
· Experience leading and coordinating testing activities in collaboration with project with project teams and a strong understanding of the various delivery methodologies such as: SDLC – Waterfall, Agile (Scrum), Hybrid, and DevOps.
· Certification in Software Quality Engineering or an equivalent credential is considered a strong asset.
· Excellent analytical skills in business processes, information systems, information management, and web UI design and accessibility.
· Strong written and verbal communication skills, with the ability to collaborate effectively across multidisciplinary teams.
Technical Capabilities:
· Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing—across web-based, mobile, and cloud platforms.
· Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc.
· Skilled in implementing automated testing using tools such as Micro Focus UFT, TOSCA, Selenium, Cucumber, as well as conducting performance testing with JMeter and OpenText Load Runner. As well as experience with platforms such as: ServiceNow, · Salesforce, SAP, or equivalent are considered an asset
· Strong experience in executing test cycles, analyzing results, and managing the full defect lifecycle using tools like OpenText ALM, OpenText Octane, JIRA, Visual Studio, Confluence, etc.
· Demonstrated capability in analyzing business requirements and user stories to design test scenarios, develop test cases and scripts, prepare test data, and assess results for quality assurance.
· The City may contact the references provided. Should any reference fail to confirm that the services listed in Section 3.0 were performed in a satisfactory manner; the Candidate may be declared non-compliant and not considered for the remainder of the evaluation process.
Deliverables
Key Deliverables
· Design and deliver detailed manual and automated test plans, test cases, and test scripts aligned with business requirements and project objectives.
· Perform various testing types (functional, regression, integration, system, performance, usability, and UAT) across multiple platforms and environments. Report and document results accordingly.
· Maintain accurate records of test discrepancies and defects using designated QA tools and provide timely reports and recommendations to stakeholders.
· On as needed basis, develop and implement automated testing frameworks and scripts using tools such as Micro Focus/OpenText UFT, Selenium, Cucumber, etc.
· On as needed bases, conduct load and stress testing using tools like Load Runner or JMeter and deliver performance analysis reports with actionable insights.
· Collaborate with business analysts and developers to create and manage test data and scenarios that support robust validation of business processes.
· Support the implementation of quality assurance processes and contribute to the continuous improvement of testing practices within Agile, DevOps, and traditional environments.
Must Haves:
· Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases.
· Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
· Extensive hands-on experience with all layers of testing: UI, Integration, Regression,
· Performance, AI-enabled systems, and User Acceptance Testing—across web-based, mobile, and cloud platforms.
· Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc.
Looking for meaningful work? We can help!
Raise is an established hiring firm with over 65 years of experience. We believe strongly in making the world a better place through work, which is why we’re a certified B Corporation and donate 10% of our profits to charity.
We strive to build teams that reflect the diversity of the communities we work in. We encourage all qualified applicants to apply, including people from traditionally underrepresented groups such as women, visible minorities, Indigenous peoples, people identifying as LGBTQ2SI, veterans, and people with visible/nonvisible disabilities.
We have a dedicated webpage for accommodations where you can learn more about what we offer, and request accommodation: https://raise.jobs/accommodations/
In order to submit candidates for roles, our clients will sometimes require personal information to confirm the identity of applicants and their legal status to work. Raise will never ask you for personal or banking information unless you have been selected for a job. If you are ever unsure about the legitimacy of this or another job posting by Raise (or have any other questions), please contact us at +1 800-567-9675 or hello@raiserecruiting.com