Remote AI Conversation Evaluator

Evaluate AI voice conversations remotely on your own schedule, using fluent English, careful listening, and precise written feedback. Review exchanges from anywhere.

Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for AI training projects. You will roleplay realistic conversations, assess naturalness, usefulness, and clarity, and explain specific issues in English. Projects also include image, video, caption, and audio evaluations.

Key Responsibilities:

• Hold scenario-based conversations with AI voice models
• Rank exchanges for naturalness, usefulness, and clarity
• Compare generated media against prompts or source materials
• Inspect outputs for visual, motion, text, and audio problems
• Write evidence-based explanations of evaluation decisions

Requirements:

• Fluent English and clear written communication
• Comfort with natural, everyday conversational speech
• Strong attention to detail and patience
• Experience writing short, evidence-based reviews
• Comfort making clear decisions between flawed options

Use English conversation skills, close observation, and clear feedback to evaluate AI outputs through Outlier’s remote projects.