IT & Software

Remote Senior Software Engineer Evaluator

g2i

Winnipeg · Manitoba · Canada

Evaluate cutting-edge AI coding interactions with a remote Senior Software Engineer role. Analyze and judge AI models like OpenAI Codex for their engineering precision and responsiveness.

This position is ideal for a Senior, Staff, or Principal-level engineer. You will leverage your expertise in TypeScript, JavaScript, or Python to determine how well AI coding agents perform in real-world scenarios. Expect a focus on writing clear, opinionated feedback based on your evaluations.

Key Responsibilities: • Evaluate AI-generated coding interactions from start to finish • Assess outputs for usefulness and engineering alignment • Provide critical feedback on quality and reasoning • Distinguish between different levels of response quality • Define what exemplary AI interactions should look like

Requirements: • Senior engineer with relevant experience in AI tools • Proficient in TypeScript, JavaScript, or Python • Familiarity with modern AI-assisted developer workflows • Strong English communication skills (B2 or above) • Comfort giving direct feedback based on evaluations

Bring your engineering expertise and judgment to assess AI interactions effectively. #J-18808-Ljbffr

Reference: WJ-3875_13329560

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

Find more on GigBlows

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.