Software Engineering AI Evaluator

Evaluate AI-generated software with Python, JavaScript, and full-stack expertise through a flexible contractor engagement with partial PST overlap.

As a Software Engineering evaluator at Turing, you will create datasets for training, benchmarking, and advancing large language models. You will collaborate with researchers and cross-functional teams on enterprise-level AI coding solutions. The work includes code curation, solution development, corrections, and structured evaluation rationales.

Key Responsibilities:

• Curate code examples across multiple programming languages
• Build solutions and correct code for AI training
• Evaluate AI-generated code for efficiency and reliability
• Build agents identifying code quality and error patterns
• Design mechanisms verifying software engineering solutions

Requirements:

• Three or more years of software engineering experience
• Full-stack application development and scalable software deployment expertise
• Understanding of architecture, debugging, development, and code quality
• Clear oral and written evaluation communication
• Residence in the United States, Canada, or specified WEU countries

Apply software engineering, code review, and evaluation expertise to advance Turing’s large language model training initiatives.