AI & Data Quality Analyst

About the Role

We are building AI‑powered data products that serve business stakeholders across the organization. We are looking for an AI & Data Quality Analyst to own the validation, QA, and regression testing of both our AI agent outputs and the underlying data pipelines. You will be the quality gate between development and production, ensuring our agents return accurate, reliable answers and our data models maintain integrity. You'll work closely with our Data team and have significant influence over how we define and measure quality.

What You’ll Do

AI/Agent Validation

• Design and execute test cases for AI agent responses across business use cases
• Validate that natural language queries return correct SQL, accurate numbers, and appropriate context
• Build and maintain regression test suites to catch regressions when semantic models or agent configurations change
• Evaluate agent response quality (accura...