English AI Model Evaluator

Evaluate AI-generated media in English for Outlier, using careful listening, visual inspection, and precise written feedback remotely on your own schedule.

Outlier, owned and operated by Scale AI, seeks fluent English speakers for AI evaluation projects. You will assess voice conversations, images, videos, and audio across adherence, quality, naturalness, pronunciation, and realism. This independent contractor opportunity supports feedback loops that improve advanced AI systems.

Key Responsibilities:

• Conduct scenario-based conversations with AI voice models
• Rank speech for naturalness, usefulness, and clarity
• Compare generated images and videos against prompts
• Inspect outputs for visual, motion, text, and audio problems
• Write evidence-based explanations in English

Requirements:

• Fluent English with strong written communication
• Comfort with natural, everyday conversational speech
• Strong attention to detail and patience
• Experience writing concise, evidence-based reviews
• Ability to decide when both options have flaws

Apply English communication, media evaluation, and detailed feedback skills while helping Outlier improve real-world AI performance.