AI Tester Midlevel

AI Tester Midlevel needs 7 years’ experience, 4-7 years of experience in Spring Boot.

Skills and Abilities

• 6+ years of experience in Software Functional testing with Automation (Selenium) knowledge

• Dallas / Tampa / Jersey City.

• Experience with Jira and ALM

• Experience in writing, and executing application tests using industry standard automated testing tools like Selenium

• Hands on experience testing LLMs and RAG architectures using vector databases or embeddings to validate retrieval accuracy in RAG based models.

• Strong knowledge of Python and experience with AI testing tools and libraries (e.g, LangChain, Pytest, Pytorch).

• Hands on experience testing LLMs and RAG architectures using vector databases or embeddings to validate retrieval accuracy in RAG based models.

• Experience in writing, and executing application tests using industry standard automated testing tools like Selenium

•

Responsibilities:

• Implement automated testing frameworks for gen AI applications such as Deep eval, RAGAs etc for evaluating and testing LLMs

• Develop custom validation scripts for Gen AI model output evaluation including accuracy, relevancy, faithfulness and performance benchmarks

• Test prompt engineering techniques to optimize responses

• Familiarity with Snowflake and executing SQL queries to validate database integrity and application responses

• Responsible for system integration testing of newly developed or enhanced applications

• Requires in-depth knowledge of the software implementation lifecycle

• Possesses good Testing Process knowledge and a detailed understanding on AGILE methodology

• Works with project teams during early stages to establish plans, standards, and procedures that will add value to the testing effort and satisfy the constraints of the project