Python AI Code Evaluator

Python expertise anchors this flexible United States contractor engagement with Turing, focused on evaluating AI-generated code. Build reliable datasets and verification tools.

As a Software Engineering evaluator, you will create datasets for training, benchmarking, and advancing large language models. The work emphasizes Python across backend services, data pipelines, and machine learning infrastructure. You will also assess code written in JavaScript, ReactJS, C/C++, Java, Rust, and Go.

Key Responsibilities:

• Curate code examples for artificial intelligence model training
• Provide precise solutions and correct software code
• Evaluate generated code for efficiency, scalability, and reliability
• Build Python agents and automated verification tools
• Design mechanisms verifying software engineering task solutions

Requirements:

• Three or more years of software engineering experience
• Strong Python expertise, frameworks, tooling, and best practices
• Full-stack application development and scalable software deployment experience
• Understanding of architecture, development, debugging, and code quality
• Clear oral and written communication for evaluation rationales

Apply production-grade Python, full-stack development, and code evaluation skills to advance Turing’s large language model systems.