Skip to content

AI Evaluation

Senior Domain Expert, Multi-Discipline AI Research Program

Its $135/hr is above the $70/hr median of the AI Evaluation & Rating (RLHF) roles open now, whose typical pay runs $35–$130/hr. How that pay moves week by week is in our research on AI Evaluation & Rating (RLHF) work.

Half of all AI Evaluation & Rating (RLHF) roles come down within 18.5 days of being listed, and 33.6% are still up after four weeks. This one was posted 10 days ago.

About the role

The work

You will help evaluate how well AI models reason through difficult, real-world technical problems. The work supports AI model research and evaluation rather than production engineering.

  • Design realistic technical scenarios and problem sets in your area of expertise.
  • Write expert reference answers and grading rubrics.
  • Review AI-generated outputs for correctness, depth, and sound domain judgment.
  • Explain your decisions clearly and provide structured technical feedback.
  • Work independently and asynchronously in a remote setting.

What it pays and takes

This role is suited to people who can apply rigorous judgment in a specialist field and explain technical decisions in writing.

  • Pay: $135 per hour.
  • Work style: Remote, flexible, and asynchronous.
  • Location: Open to candidates in the countries listed for this role.
  • Language: Professional fluency in English.
  • Experience: Current or recent hands-on professional activity in at least one relevant specialist field.
  • Education and experience must meet the requirements for at least one available track.
  • Strong written communication for technical explanations, reference answers, and evaluation feedback.
  • Relevant fields may include software or systems engineering, formal methods, computational science, ML inference, GPU kernels, enterprise operations, security, hardware design, and creative technology.
  • Helpful experience includes technical review, grading, code review, peer review, editing, research publications, or recognized work products.
  • Track-specific expertise may include theorem proving, reverse engineering, cryptanalysis, RTL, CAD, robotics, audio engineering, linguistics, or multimodal design.

How it works

Apply on OpenTrain with your resume and then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that generate and assess text, code, and other content. OpenTrain is where people find these projects, build a profile, and apply to opportunities across the industry; experienced specialists are paid for the expert judgment they bring to model evaluation.

Where you can work

This role is 100% remote, for applicants located in these 95 countries: United Arab Emirates, Antigua and Barbuda, Albania, Armenia, Austria, Australia, Bosnia and Herzegovina, Belgium, Bulgaria, Bahrain, Benin, Brunei, Bahamas, Bhutan, Botswana, Canada, Switzerland, Cote d'Ivoire, Costa Rica, Cyprus, Czechia, Germany, Denmark, Algeria, Ecuador, Estonia, Spain, Ethiopia, Finland, France, United Kingdom, Gambia, Greece, Guatemala, Guyana, Hong Kong, Croatia, Hungary, Indonesia, Ireland, Israel, India, Iceland, Italy, Jamaica, Jordan, Kenya, Kuwait, St. Lucia, Liechtenstein, Sri Lanka, Lithuania, Luxembourg, Latvia, Morocco, Moldova, Madagascar, North Macedonia, Mongolia, Malta, Mauritius, Mexico, Malaysia, Mozambique, Namibia, Netherlands, Norway, New Zealand, Oman, Panama, Peru, Philippines, Pakistan, Poland, Portugal, Qatar, Romania, Serbia, Rwanda, Sweden, Singapore, Slovenia, Slovakia, Senegal, El Salvador, Thailand, Tunisia, Türkiye, Trinidad and Tobago, Taiwan, Tanzania, United States, Uzbekistan, Vietnam and South Africa.

From OpenTrain AI's job posting, checked 16 Nov 2026.

About OpenTrain AI

A unified board of AI-training jobs with real per-role pay.

How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.

When it pays: When the employer approves each funded milestone. How often others pay

Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works

Similar open roles

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new OpenTrain AI roles by email

We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.