Skip to content

Agentic & RL Envs

AI Developer Trace Task Auditor

Mercor logoMercor$70–$90/hrRemote in United StatesContractPosted 2mo ago
Apply on Mercor (opens the job details)Is Mercor legit? Pay and reviews

The middle of its range, $80/hr, is above the $55/hr median of the Agentic Tasks & RL Environments roles open now, whose typical pay runs $50–$120/hr. How that pay moves week by week is in our research on Agentic Tasks & RL Environments work.

Half of all Agentic Tasks & RL Environments roles come down within 9.3 days of being listed, and 33.6% are still up after four weeks. This one was posted 77 days ago.

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.

About the role

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools - judging correctness, workflow soundness, and reasoning - and provide clear, rubric-based written feedback.

Basic Qualifications

  • 3+ years professional software development
  • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)
  • Strong code-reading and debugging skills across full-stack or backend systems
  • Ability to evaluate multi-step coding trajectories for correctness and best practice

Preferred Qualifications

  • Experience with Kiro or Amazon CodeCatalyst
  • Prior work evaluating or grading AI-generated code
  • Contributions to developer tooling

Where you can work

This role is 100% remote, for applicants located in United States.

From Mercor's job posting, checked 14 Nov 2026.

Apply on Mercor (opens the job details)

About Mercor

Premium expert network: physicians, lawyers, engineers, PhDs.

How it pays: Weekly via Stripe (1099 contractors).

When it pays: Every Wednesday, for the week before. How often others pay

Interview: yes, for everyone it takes (AI Video Interview (plus role-specific assessments)). How the Mercor AI interview works

Mercor jobs with full postings Every open Mercor role Read the full Mercor review

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

An experienced engineer?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new Mercor roles by email

We check the Mercor job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.