Gen AI Senior QA Analyst - RQ01381

Gen AI Senior QA Analyst - RQ01381

Duration: 1 year to start

Location: Hybrid - Downtown Toronto (2-3 days a week)

Reporting to the Gen AI QA Lead and as part of Canada's Products & Technology organization, this role presents an exciting opportunity to contribute towards cutting-edge Gen AI solutions that will shape how we deliver value to our clients and our people. The successful candidate will have an opportunity to work with a team of talented technology and business specialists to design and develop tailored Generative AI tools that transform key areas of our business and to foster a culture of innovation.

The Gen AI Senior QA Analyst will be instrumental in delivering high-quality solutions that meet and exceed commitment to innovation, client satisfaction, and continued technological growth

Must Have Skills:

• 4+ years experience as a QA performing different types of testing for complex applications
• 2+ years using automated testing tools and platforms (Playwright, JMeter, SoapUI, postman)
• Experience with software development tools and defect tracking systems like Azure DevOps, Jira
• Database experience (SQL)
• Knowledge of Python for Gen AI development and testing
• Competent in designing and executing AI prompt engineering and testing scenarios, ensuring the robustness of AI and large language models
• Working with high level UX principles such as user stories, persona building, prototype/prototype development approaches and information architecture and customer/product research methodologies (e.g., A/B testing and MVT)
• Experience with Agile methodologies

Nice To Have Skills:

• Undergraduate Degree in a technical field

Deliverables:

• Designing, implementing, and maintaining both manual and automated testing procedures
• Conducting functional, system, integration, and performance testing.
• Collaborate closely with development and product management teams to ensure Gen AI technology solutions undergo comprehensive testing and meet acceptance criteria.
• Participate in all testing activities during the agile product implementation process, ensuring the quality and reliability of our Gen AI solutions
• Facilitate communication between development teams, UX/UI designers, and product managers to ensure alignment on project goals and quality standards
• Contribute to insights, risk evaluations and estimation discussions, ensuring that testing considerations are well-integrated into project planning
• Analyze project requirements, user feedback, and architectural and design documents to ensure completeness and testability
• Formulate and execute robust test strategies tailored to the specific requirements of Gen AI projects
• Craft comprehensive test plans and test cases
• Update test documentation, and create comprehensive reports while maintaining traceability back to project requirements
• Investigate and determine the source of problems, which may include identifying test deficiencies or deviations from requirements
• Utilize defect tracking system to record, trace, and drive the resolution of defects and issues discovered during testing
• Assist in reproducing issues and conducting root cause analysis to facilitate swift resolution
• Participate in daily stand-up meetings and provide regular updates on issues, status, and progress to the scrum master, ensuring transparent communication within the team
• Propose innovative ideas and improvements to the testing process for the Gen AI solutions, continuously enhancing its effectiveness, speed and quality
• Identify and implement in-house testing automation frameworks to streamline and expedite the testing process