Gen AI Tester
Apply NowCompany: Diverse Lynx LLC
Location: Dallas, TX 75217
Description:
Skills: AI & Gen AI - Products & Tools, Selenium
Job Description:
6+ years of experience in Software Functional testing with Automation (Selenium) knowledge and
Skills Required:
Responsible for system integration testing of newly developed or enhanced applications
Requires in-depth knowledge of the software implementation lifecycle
Possesses good Testing Process knowledge and a detailed understanding on AGILE methodology
Works with project teams during early stages to establish plans, standards, and procedures that will add value to the testing effort and satisfy the constraints of the project
Ensures on-time delivery of work including monitoring of external and internal dependencies, tracking of progress, and monitoring of project milestones accomplishments by:
o Recording work status information and generating status reports
o Tracking and reporting actual versus planned completion
o Ensuring all activity is accurately recorded and reported
Drives the education of Business and Development teams on the testing model, methodology, and processes, particularly end-to-end testing, and its role in quality assurance
Demonstrates Leadership characteristics while handling Product, Development, EAS, and other stakeholders
Demonstrates proficiencies in Project and Quality management, Issue management, and Communication
Assists Testing Manager in reviewing Portfolio Management and Resource Management forecast reports, to optimize team's supply/demand planning, maximizing resource utilization
Monitors adherence to quality standards during the testing of production applications, identifies areas of strengths and weakness
Identifies process improvement opportunities and communicates to the project coordinator
Experience with Jira and ALM Domain Knowledge:
Ability to works closely with business and development subject matter experts, to continually improve depth and breadth of knowledge for the assigned applications/systems Automation:
Experience in writing, and executing application tests using industry standard automated testing tools like Selenium AI Specific Testing:
Hands on experience testing LLMs and RAG architectures using vector databases or embeddings to validate retrieval accuracy in RAG based models.
Implement automated testing frameworks for gen AI applications such as Deep eval, RAGAs etc for evaluating and testing LLMs
Strong knowledge of Python and experience with AI testing tools and libraries (e.g, Lang Chain, Pytest, Pytorch)
Develop custom validation scripts for Gen AI model output evaluation including accuracy, relevancy, faithfulness and performance benchmarks
Test prompt engineering techniques to optimize responses
Familiarity with Snowflake and executing SQL queries to validate database integrity and application responses
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Job Description:
6+ years of experience in Software Functional testing with Automation (Selenium) knowledge and
Skills Required:
Responsible for system integration testing of newly developed or enhanced applications
Requires in-depth knowledge of the software implementation lifecycle
Possesses good Testing Process knowledge and a detailed understanding on AGILE methodology
Works with project teams during early stages to establish plans, standards, and procedures that will add value to the testing effort and satisfy the constraints of the project
Ensures on-time delivery of work including monitoring of external and internal dependencies, tracking of progress, and monitoring of project milestones accomplishments by:
o Recording work status information and generating status reports
o Tracking and reporting actual versus planned completion
o Ensuring all activity is accurately recorded and reported
Drives the education of Business and Development teams on the testing model, methodology, and processes, particularly end-to-end testing, and its role in quality assurance
Demonstrates Leadership characteristics while handling Product, Development, EAS, and other stakeholders
Demonstrates proficiencies in Project and Quality management, Issue management, and Communication
Assists Testing Manager in reviewing Portfolio Management and Resource Management forecast reports, to optimize team's supply/demand planning, maximizing resource utilization
Monitors adherence to quality standards during the testing of production applications, identifies areas of strengths and weakness
Identifies process improvement opportunities and communicates to the project coordinator
Experience with Jira and ALM Domain Knowledge:
Ability to works closely with business and development subject matter experts, to continually improve depth and breadth of knowledge for the assigned applications/systems Automation:
Experience in writing, and executing application tests using industry standard automated testing tools like Selenium AI Specific Testing:
Hands on experience testing LLMs and RAG architectures using vector databases or embeddings to validate retrieval accuracy in RAG based models.
Implement automated testing frameworks for gen AI applications such as Deep eval, RAGAs etc for evaluating and testing LLMs
Strong knowledge of Python and experience with AI testing tools and libraries (e.g, Lang Chain, Pytest, Pytorch)
Develop custom validation scripts for Gen AI model output evaluation including accuracy, relevancy, faithfulness and performance benchmarks
Test prompt engineering techniques to optimize responses
Familiarity with Snowflake and executing SQL queries to validate database integrity and application responses
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.