QA Automation Engineer - Playwright Python LLM Testing

NISHI GROVER

QA Automation Engineer Chatbot & Conversational AI Tester Playwright Python PyTest *****.******@*****.*** +91-942******* linkedin.com/in/nishi-grover-0b923423 PROFESSIONAL SUMMARY

● QA Automation Engineer / SDET with 4+ years of experience in Manual Testing and Test Automation, with hands-on expertise in Python, Playwright and PyTest.

● Hands-on experience in Chatbot, Voice Bot and Conversational AI testing, including LLM, RAG, prompt, hallucination and guardrail validation.

● Currently testing AI-powered Accounts Payable (AP) automation at e42.ai, covering invoice processing, OCR/ICR extraction, GST/TDS/VAT validation, PO/GRN/invoice matching, approval workflows and ERP/SAP integration testing.

● Experienced in Selenium WebDriver with Python, Postman for basic API request/response validation, JIRA, Git/GitLab, Jenkins and Agile/Scrum.

TECHNICAL SKILLS

Programming: Python

UI Automation: Selenium WebDriver, Playwright, PyTest, Page Object Model (POM) API Testing: Postman, API request/response validation AI / GenAI Testing: LLM Testing, Chatbot Testing, Voice Bot Testing, Conversational AI Testing, Prompt Validation, RAG Testing, Hallucination Testing, Guardrail Testing

AI / LLM Tools: IBM Watson Assistant, ChatGPT

Backend: Django, API validation

CI/CD & Version Control: Git, GitLab, Jenkins, GitLab CI/CD Testing: Functional, Regression, Smoke, Sanity, Integration, System, Exploratory, End-to-End (E2E), Compatibility, UAT, Test Data Management, Test Reporting

Methodologies: Agile, Scrum

PROFESSIONAL EXPERIENCE

e42.ai Quality Analyst / Test Automation Engineer Apr 2026 – Present

● Test Neil, e42.ai's AI-powered Accounts Payable (AP) automation co-worker for enterprise clients including Ajanta Pharma Limited, Phoenix Mills Limited (PML) and Nielsen on dedicated client-specific web UAT environments.

● Own QA documentation and test case authoring for invoice processing automation, including invoice ingestion, OCR/ICR data extraction, PO/GRN/invoice matching (2-way, 3-way and N-way), GST/TDS determination, Straight-Through Processing (STP), exception and approval workflows, and ERP/SAP integration (SAP PI/PO).

● Author automation-ready test case workbooks with 150–350+ cases across 13–15 modules, QA Test Plans, Test Scenario workbooks, Requirement Traceability Matrices (RTM) and QA/User Guides derived from BRD analysis.

● Perform hands-on invoice data validation across GST/VAT breakdowns, PO numbers, HSN codes, multi- currency and multi-country invoices, including RCM, SEZ supplies, duplicate invoice detection and vendor master mismatches.

● Validate role-based access control, email/system notifications, audit trails, dashboards and reporting modules across maker-checker approval hierarchies.

● Contribute to the Playwright UI automation framework by creating and maintaining Python-based test scripts, adding page-level actions and assertions, and keeping automated tests aligned with UI changes.

● Use reusable locators, test data and common methods in the automation framework to reduce repeated code and make test scripts easier to maintain.

● Execute automated regression tests, review failures, identify whether failures are due to application changes or test-script issues, and update scripts when required.

● Perform basic API request/response validation with Postman.

● Use JIRA and GitLab for requirements and defect tracking; drive defect triage and root cause analysis (RCA) with developers and support UAT coordination/sign-off with client stakeholders.

● Contributed to Corro-Health, Milacron and an Airtel POC. Streebo, Inc. Quality Analyst Aug 2022 – Apr 2026

● Led QA teams across multiple parallel projects and delivered testing for Web, Mobile, Chatbot and Voice Bot applications.

● Tested Streebo's low-code/no-code Digital Automation product suite, including Chatbot/AI Agent Builder, App Builder, Form Builder and Digital Experience Accelerator (DXA).

● Configured chatbot skills for WhatsApp by adding intents and dialogue flows, then tested chatbot behavior and responses against expected conversational scenarios.

● Validated Chat and Voice Bots across web, mobile web, WhatsApp, Facebook Messenger, MS Teams, Telegram, SMS, Amazon Alexa.

● Performed NLP and Conversational AI testing using IBM Watson Assistant, covering intent recognition, entity extraction, utterance/dialog-flow validation, confidence scoring, fallback, disambiguation, context retention and multi-turn conversations.

● Performed hands-on RLHF training in ChatGPT and LLM/RAG testing, cognitive/enterprise search validation, transactional bot-flow testing and backend-integrated entity recognition.

● Performed prompt testing and prompt engineering validation for LLM-backed conversational flows, including prompt-response accuracy, relevance, consistency, system prompts, few-shot examples, context injection, negative/adversarial prompts, hallucination, out-of-scope responses and prompt regression.

● Worked with Selenium WebDriver and Python in an established automation framework and Jenkins/GIT CI/CD pipelines; maintained automation scripts, executed automated regression suites and triaged script failures.

● Owned test case design, test execution, defect reporting and regression suite maintenance across the STLC, including Functional, Regression, Integration, Smoke, Sanity, Ad-hoc, Cross-Browser and Compatibility testing, with backend validation of bot integrations.

● Used JIRA for project tracking, defect tracking and test case management across Tata One Click, MedEye, Aramco, QDB, Santee Cooper and Powell projects.

● Participated in Agile/Scrum ceremonies and engaged directly with global clients on requirements, demos and UAT support.

EDUCATION

M.Tech, Computer Science Engineering Sanghvi Institute of Management and Science, Indore 8.0 CGPA B.E., Computer Science Engineering Dadaji Institute of Technology and Science, Khandwa 8.2 CGPA

Contact this candidate