Full-time

Software Test Engineer – AI POC (LLM / RAG & Agentic AI)

Posted by Ideas to Impacts • Pune, Maharashtra, India

📍 Pune, Maharashtra 🕒 February 20, 2026

About the Role

This role is part of a time-bound AI Proof of Concept (POC) focused on LLM / RAG output evaluation and Agent-based (Agentic) AI workflows.

The selected candidate is expected to contribute independently and be productive from Week 2.
There is no training or grooming bandwidth available for this role.

Key Responsibilities:

  • Test and validate LLM-based and RAG-driven AI systems

  • Perform AI output evaluation for relevance, accuracy, consistency, and hallucinations

  • Apply standard NLP / LLM evaluation metrics during testing

  • Test Agent-based (Agentic) AI workflows, including agent-to-agent interactions

  • Write and execute Python-based test scripts for AI validation

  • Perform functional, regression, and performance testing for AI POCs

Ready to Apply?

Submit your application today and take the next step in your career journey with Ideas to Impacts.

Apply Now