Gen AI QA Automation Engineer
Work Location: Coimbatore
Work Mode: Hybrid / Remote
Notice Period: 0–30 Days
Experience: 4+ years in QA Automation (including 1+ year in Generative AI Testing)
Job Description
We are looking for a QA Gen AI Automation Engineer with strong expertise in Python, QA Automation, and Generative AI Testing. The ideal candidate will be responsible for validating AI-powered applications, developing automated test frameworks, performing API and performance testing, and ensuring the quality and reliability of Gen AI solutions in an Agile environment.
Responsibilities
- Design, develop, and maintain automated test scripts using Python, Selenium/Playwright, and pytest.
- Perform API testing using Postman and web service testing (REST/SOAP). Test and validate Generative AI applications, including LLMs, RAG, and Chatbots.
- Evaluate AI model outputs using frameworks such as DeepEval and RAGAS. Execute performance and load testing using JMeter.
- Perform database testing using SQL, Pandas DataFrames, and Vector Databases (e.g., OpenSearch).
- Integrate automated tests into CI/CD pipelines using Jenkins or Bamboo.
- Collaborate with Agile teams using JIRA and Confluence.
- Identify, troubleshoot, and report product defects while ensuring application quality and stability.
Qualifications
- Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field.
- 4+ years of QA Automation experience with 1+ year in Generative AI Testing.
- Strong programming skills in Python (preferred) or Java.
- Hands-on experience with Selenium WebDriver/Playwright, pytest, Postman, JMeter, and SQL. Knowledge of LLMs, RAG, Chatbots, AI Testing, and REST APIs.
- Experience with CI/CD tools such as Jenkins or Bamboo. Familiarity with Agile/Scrum, JIRA, and Confluence.
- Strong analytical, debugging, and problem-solving skills.
Nice to have Skills
- Knowledge of Agentic AI, MCP, and AI agent architectures.
- Experience with observability tools such as Langfuse.
- Familiarity with AWS Bedrock or other cloud AI services.
- Software development experience.
- Understanding of the Property & Casualty (P&C) Insurance domain.
