Skip to content

Coding

Senior Software Engineer, LLM Evaluation

OpenTrain AI logoOpenTrain AI~$70–$150/hrtypicalRemote in United StatesContractPosted 1w ago

Half of all Coding & Software Evaluation roles come down within 27 days of being listed, and 48.9% are still up after four weeks. This one was posted 9 days ago.

About the role

The work

You will improve AI coding systems by creating accurate software examples, correcting generated code, and judging whether solutions are correct, efficient, scalable, reliable, and maintainable. Your work will support training and benchmarking datasets for large language models.

The role combines hands-on full-stack engineering with structured model evaluation. You will assess software across prototyping, architecture, API design, production implementation, experimentation, monitoring, and operational maintenance.

  • Curate code examples and create solutions for backend, frontend, API, and machine learning workflows.
  • Review and refine AI-generated code for correctness, maintainability, scalability, and reliability.
  • Evaluate coding systems against software development and production performance benchmarks.
  • Build agents and automated checks that verify code quality and identify recurring errors in full-stack applications.
  • Work with cross-functional teams on AI coding solutions and evaluation benchmarks.

What it pays and takes

This is a contractor, part-time role open to candidates in the United States. The work requires at least 20 hours per week and professional fluency in English.

  • Pay: No rate is provided.
  • Location: Open to candidates in the United States.
  • Schedule: 20 or more hours per week.
  • Experience: At least three years of software engineering experience.
  • Technical skills: Strong full-stack development in Python and JavaScript, including React and Node.js.
  • Additional systems experience: C, C++, Java, Rust, or Go.
  • Knowledge: Software architecture, design, development, debugging, scalable production software, and code-quality assessment.
  • Communication: Clear spoken and written explanations for structured evaluation decisions.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work is the human side of building artificial intelligence. Contributors create examples, review model outputs, and evaluate software so AI systems can learn to produce more useful and reliable results. OpenTrain helps people find these roles, build a profile, and start applications in one place.

Where you can work

This role is 100% remote, for applicants located in United States.

From OpenTrain AI's job posting, checked 16 Nov 2026.

About OpenTrain AI

A unified board of AI-training jobs with real per-role pay.

How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.

When it pays: When the employer approves each funded milestone. How often others pay

Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works

Similar open roles

An experienced engineer?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new OpenTrain AI roles by email

We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.