Information Technology_USA - USA_Quality Manager

Please strictly adhere to the following resume naming convention:
ALL CAPS, NO SPACES B/T UNDERSCORES

-- (Max)

PTN_US_GBAMSREQID_CandidateBeelineID
i.e. PTN_US_9999999_SKIPJOHNSON0413

MSP Owner: Shilpa Bajpai
Location: Denver, CO (Zip Code-80221)- REMOTE
skill id: 10902001

Role: AI Agentic Tester
Skills: QA/Test Engineering experience
Must have- Experience testing Generative AI, LLM, or AI-based applications.

Role Descriptions: AI Agentic Tester
Essential Skills: AI Agentic Tester
Desirable Skills:
Keyword:
Skills: Modern Functional Quality Engineering
Experience Required: 2-4 Years

PFB the responsibilities and skills needed:

Functional Testing

Validate AI agent workflows against business requirements.
Test end-to-end AI use cases, including multi-agent interactions.
Verify task completion accuracy and output quality.
Test agent orchestration, tool calling, and workflow execution.
AI Model Validation

Evaluate LLM responses for accuracy, relevance, and consistency.
Test prompt engineering effectiveness and response quality.
Validate Retrieval-Augmented Generation (RAG) outputs.
Measure hallucination rates and response reliability.

Required Skills
3-8 years of QA/Test Engineering experience.
Experience testing Generative AI, LLM, or AI-based applications.
Knowledge of AI Agents, Agentic AI, RAG, and prompt engineering.
Hands-on experience with API testing (Postman, Swagger, REST APIs).
Experience with automation frameworks (Selenium, Playwright, PyTest).
Proficiency in Python.
Understanding of AI evaluation metrics and testing methodologies
Knowledge of Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms