German AI Evaluator

About the role:

We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. This project focuses on creating a rich and diverse dataset of written German text, annotated and corrected by humans.

Responsibilities:

• Respond to a set of prompts simulating realistic business or casual communication.
• Write clear, plausible short texts (3–4 sentences for business settings, 1–2 sentences for casual chat).
• Generate responses with intentional but realistic grammar, spelling, and structural errors.
• Review annotated message pairs (input text corrected/proofread version) to ensure:
• All grammar/spelling/preposition/punctuation errors are corrected appropriately
• Meaning is preserved between input and corrected text
• Error types are classified correctly
• Explanations are clear and linguistically sound
...