In this project, you will perform language and dialect identification tasks, reviewing responses from two different models and deciding which one identified a proposed language correctly. You’ll select answers from predefined options such as “none,” “first model,” “second model,” “both,” or “reject.”

Your input will play a vital role in training safer and more accurate AI systems!

Responsibilities

Annotate and evaluate ~200 samples in Luo

Select the correct model outputs from predefined options

Ensure accurate language/dialect identification and consistent annotations

Requirements

Native (or near-native) fluency in Luo

Advanced English skills (to understand instructions)

Linguistic studies or equivalent background

Reliable internet connection and personal computer

Ability to follow detailed annotation guidelines

Comfortable working with potentially sensitive or objectionable content