Senior Software Engineer AI Evaluation Coding Agents
The middle of its range, $125/hr, is above the $70/hr median of the Coding & Software Evaluation roles open now, whose typical pay runs $40–$130/hr. How that pay moves week by week is in our research on Coding & Software Evaluation work.
Half of all Coding & Software Evaluation roles come down within 27 days of being listed, and 48.9% are still up after four weeks. This one was posted 52 days ago.
About the role
The work
You will evaluate AI-generated code and coding-agent behavior using real-world software repositories. Your reviews will help AI systems improve through structured human judgments and clear technical feedback.
- Review model outputs and source materials against project guidelines.
- Apply evaluation rubrics and make evidence-based judgments.
- Explain why an implementation is correct or incorrect.
- Document technical decisions in clear written feedback.
- Help maintain consistent quality across repeated review tasks.
- Support evaluation processes for AI coding agents.
What it pays and takes
This is a part-time contractor role. The work requires strong real-world software engineering knowledge, but prior AI training experience is not required.
- Pay: $100 to $150 per hour.
- Time: 20 or more hours per week.
- Location: Open to candidates in the United States and Canada.
- Language: Professional fluency in English.
- Experience: At least 5 years of hands-on software engineering experience.
- Programming: Strong proficiency in Python, TypeScript or JavaScript, Go, or another major production language.
- Codebases: Experience working in substantial real-world codebases.
- Core skills: Strong code review, technical judgment, and written communication.
- Technical knowledge: Familiarity with modern large language models or AI coding tools.
- Helpful experience: LLM evaluation, coding agents, RLHF, preference data, rubric design, or post-training.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training is the human work behind systems that generate and understand content, including code. Reviewers use subject knowledge to assess examples and explain what good model behavior looks like, which is why experienced software engineers are needed for specialist projects.
Where you can work
This role is 100% remote, for applicants located in Canada and United States.
From OpenTrain AI's job posting, checked 16 Nov 2026.
About OpenTrain AI
A unified board of AI-training jobs with real per-role pay.
How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.
When it pays: When the employer approves each funded milestone. How often others pay
Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works
Similar open roles

Open Source GitHub Maintainer Code Review (opens the job details)
OpenTrain AI · Coding · Remote· 1mo agoDetails
$120–$200/hr

Full-Stack Engineer (opens the job details)
OpenTrain AI · Coding · Remote· 2mo agoDetails
$50–$100/hr
Language Expert (Korean Audio Transcription) (opens the job details)
OpenTrain AI · Transcription & Audio · Remote· 1mo agoDetails
$20–$36/hr
Senior Mobile Developer AI Coding Tasks (opens the job details)
OpenTrain AI · Coding · Remote· 1mo agoDetails
$50–$100/hr
An experienced engineer?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new OpenTrain AI roles by email
We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.