Role Summary
The Test Lead is responsible for defining the test strategy and leading automation execution for AI-enabled applications. The role provides technical leadership and ensures consistent quality across UI, API, and data layers.
Key Responsibilities
- Define an automation-first, end-to-end test strategy covering AI agents, orchestration layers, backend APIs, and UI applications.
- Lead and govern Selenium and/or Playwright-based automation frameworks across multi-agent workflows, APIs, and portals.
- Provide technical guidance and conduct code reviews for Java- and Python-based automation implementations.
- Oversee testing across AI agents and services supporting end-to-end automated and analytical workflows.
- Review and guide AI testing coverage, including prompt testing, guardrail validation, response accuracy, and reasoning checks.
- Ensure adequate test coverage for the System Under Test (SUT).
- Lead regression planning, defect triage, root cause analysis (RCA), reporting, and release sign-offs.
- Mentor test engineers and ensure consistent QA standards, best practices, and automation quality.
Requirements
Required Skills (Must Have)
- Strong automation development experience
- Proficiency in Java or Python
- Expertise in Selenium and/or Playwright frameworks
- Experience in API automation and SQL-based data validation
- Hands-on knowledge of at least one AI testing tool (e.g., Testsigma, Testim, Mabl, or Functionize)
- Understanding of cloud-based platforms (e.g., Microsoft Azure)
- Minimum of 2 years of hands-on experience testing GenAI and Agentic AI solutions across production, client-facing, or enterprise systems, including involvement in test coordination and review activities
Good to Have
- ERP / Accounts Payable knowledge (e.g., Oracle ERP, SAP)
- ISTQB certification