QA Lead

Job Description

Required Qualifications:

Bachelor’s degree in computer science, Engineering, or related field.

5+ years of experience in software QA or test automation.

1–2 years experience testing AI/ML applications or data pipelines.

Strong understanding of REST APIs, LLM behavior (e.g., OpenAI, Claude), NLP tasks, and AI evaluation metrics.

Hands-on experience with test automation tools (e.g., Selenium, Postman, Pytest, Robot Framework).

Experience in Python or Java -based test scripting.

Familiarity with CI/CD tools (Jenkins, GitHub Actions, etc.).

Ability to write and execute SQL queries for data validation.

Preferred Skills:

Exposure to prompt engineering and LLM evaluation techniques

Experience with vector databases, embeddings, or agent frameworks (LangChain, LangGraph, etc.)

Knowledge of model fairness, safety, and explainability testing

Experience in using tools like Weights & Biases, MLflow, or similar for AI monitoring

Performance testing experience with tools like JMeter or Locust