About the Role
AI Evaluation & Data Engineering Specialist
Guadalajara MX
We are looking forAI Evaluation & Data Engineering Specialiststo design, curate, and operationalize datasets and evaluation frameworks for AI product performance assessment.
This role involves working with large language models (LLMs), human raters, and automation tools to measure model accuracy, correctness, and usability.
Key Responsibilities
Build and maintainevaluation datasetsfor AI models across programming languages (Python, Golang, Java Script, Java).
Develop and applydata labeling and scoring guidelinesbased on Google’s evaluation framework.
ImplementLLM-judge calibration workflowsto align automated and human evaluations.
Performerror analysis, drift detection , and regression testing of AI model outputs.
Collaborate with automation engineers to integrate datasets into evaluation pipelines.
Supportrater training , inter-rater reliability checks, and dataset validation reviews.
Managedat...
Guadalajara MX
We are looking forAI Evaluation & Data Engineering Specialiststo design, curate, and operationalize datasets and evaluation frameworks for AI product performance assessment.
This role involves working with large language models (LLMs), human raters, and automation tools to measure model accuracy, correctness, and usability.
Key Responsibilities
Build and maintainevaluation datasetsfor AI models across programming languages (Python, Golang, Java Script, Java).
Develop and applydata labeling and scoring guidelinesbased on Google’s evaluation framework.
ImplementLLM-judge calibration workflowsto align automated and human evaluations.
Performerror analysis, drift detection , and regression testing of AI model outputs.
Collaborate with automation engineers to integrate datasets into evaluation pipelines.
Supportrater training , inter-rater reliability checks, and dataset validation reviews.
Managedat...
Ready to Apply?
Submit your application today and take the next step in your career journey with Net2Source.
Apply Now