Senior Software Engineer: Agentic Coding RL Envs
About the role
Senior Software Engineer: Agentic Coding RL Environments
Frontier labs train and evaluate their coding agents on the RL environments and benchmarks you'll build. Make $200–300k+/year.
Start the coding screen
At a glance
$100–$150+/hour
Pay scales with your expertise
20-40+ hrs/week
What most people do
Guaranteed projects
Fully remote
Choose your own schedule
The problem
Coding agents are strong today in many ways, but frustratingly bad in others. They miss edge cases, make brittle changes, and often need close supervision from an experienced engineer.
That's where you come in. To train better agents, we need the taste, judgment, and wisdom you've built over a career shipping scaled production systems.
What you'll do
You’ll build coding RL environments and benchmarks that test how agents perform on realistic software engineering tasks.
That includes
- Designing tasks based on real engineering work
- Reviewing and red-teaming model output
- Writing tests, rubrics, and success criteria
- Giving structured feedback that improves future models
We provide the framework, tools, examples, and feedback you need to get started. You’re in charge of the when, where, and how you complete projects.
Real-world impact
During training
Frontier labs train on the agentic coding RL environments you create.
Before release
Labs rely on expert SWEs to pressure-test models and surface failures.
After release
The industry uses the benchmarks you build to know which models are best.
The environments you build are used to train, evaluate, and compare frontier coding models. See our research and benchmarks for examples.
You’ll also develop a deep understanding of where coding agents succeed, where they fail, and how experienced engineers can use them effectively.
Who we're looking for
Professional software engineering experience shipping real, scaled production systems.
Strong judgment about what "good code" and a "model failures" look like
Comfort working independently, and giving technical feedback
Expertise in at least one common tech stack, such as TypeScript, Python, Ruby, PHP, Java, Rust, Go, or C++
You do not need prior AI or machine-learning experience. Strong engineering judgment and attention to detail matter most.
How it's structured
This is a fully remote contractor role paying $100–$150+/hour. Rates scale with your experience and depth in the area. Some projects go well past the top of that range.
You choose when and where you work, use your own equipment, and communicate primarily through Slack, with occasional video calls.
You're judged on the quality of what you produce. Quality matters more than speed.
Most contributors choose to spend at least 20-40 hours per week.
Apply now
Not a traditional role
This opportunity celebrates your SWE expertise, but it isn't for everyone. Those who love it really love it.
There are no sprint ceremonies, routine one-on-ones, office requirements, or feature roadmaps. Instead, you’ll focus on one goal: creating rigorous environments that teach coding agents to perform better on real software engineering work.
The role is best suited to engineers who enjoy independent work, technical review, experimentation, and high standards.
You won't have: a manager, 1:1s, workplace politics, OKR ceremonies, or Jira backlog grooming.
You will have: regular feedback on your work; full autonomy over how you expose model failures; deep fluency with what makes coding agents succeed and fail.
Application process
STEP 1
Coding capability screen
A couple of hours. This replaces a multi-round interview loop.
STEP 2
ID verification
STEP 3
PAID
First real task
Do well, and you're on the team.
Start the coding screen
Questions? swe@surgehq.ai
Where you can work
This role is 100% remote: you can work from anywhere in the world.
From Surge AI's job posting, checked Oct 22, 2026.
About Surge AI
Premium, invite-only RLHF and expert data for frontier labs.
How it pays: Weekly via Hyperwallet or PayPal.
Similar open roles
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. The roles of platforms that pay us a referral fee come first.

Senior Software Engineer – Open Source & SWE-Bench Evaluation (opens the job details)
Anyone AI · Agentic & RL Envs · Remote· 1w agoDetails
$65/hr
Software Engineers: Paid Code Review for AI Agent Evaluation (opens the job details)
Terac · Agentic & RL Envs · Remote· 2w agoDetails
$65/hr
Senior Software Engineer - AI Evaluation / Coding Agents ($100-150/hr) (opens the job details)
Turing · Agentic & RL Envs · Remote· 1mo agoDetails
$100–$150/hr
$35/hr
An experienced engineer?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new Surge AI roles by email
We check the Surge AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.