Skip to content

Coding

Senior Software Engineer AI Evaluation Coding Agents

OpenTrain AI logoOpenTrain AI$100–$150/hrRemote in Canada, United StatesContractPosted 1mo ago

The middle of its range, $125/hr, is above the $70/hr median of the Coding & Software Evaluation roles open now, whose typical pay runs $40–$130/hr. How that pay moves week by week is in our research on Coding & Software Evaluation work.

Half of all Coding & Software Evaluation roles come down within 27 days of being listed, and 48.9% are still up after four weeks. This one was posted 52 days ago.

About the role

The work

You will evaluate AI-generated code and coding-agent behavior using real-world software repositories. Your reviews will help AI systems improve through structured human judgments and clear technical feedback.

  • Review model outputs and source materials against project guidelines.
  • Apply evaluation rubrics and make evidence-based judgments.
  • Explain why an implementation is correct or incorrect.
  • Document technical decisions in clear written feedback.
  • Help maintain consistent quality across repeated review tasks.
  • Support evaluation processes for AI coding agents.

What it pays and takes

This is a part-time contractor role. The work requires strong real-world software engineering knowledge, but prior AI training experience is not required.

  • Pay: $100 to $150 per hour.
  • Time: 20 or more hours per week.
  • Location: Open to candidates in the United States and Canada.
  • Language: Professional fluency in English.
  • Experience: At least 5 years of hands-on software engineering experience.
  • Programming: Strong proficiency in Python, TypeScript or JavaScript, Go, or another major production language.
  • Codebases: Experience working in substantial real-world codebases.
  • Core skills: Strong code review, technical judgment, and written communication.
  • Technical knowledge: Familiarity with modern large language models or AI coding tools.
  • Helpful experience: LLM evaluation, coding agents, RLHF, preference data, rubric design, or post-training.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that generate and understand content, including code. Reviewers use subject knowledge to assess examples and explain what good model behavior looks like, which is why experienced software engineers are needed for specialist projects.

Where you can work

This role is 100% remote, for applicants located in Canada and United States.

From OpenTrain AI's job posting, checked 16 Nov 2026.

About OpenTrain AI

A unified board of AI-training jobs with real per-role pay.

How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.

When it pays: When the employer approves each funded milestone. How often others pay

Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works

Similar open roles

An experienced engineer?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new OpenTrain AI roles by email

We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.