Skip to content

AI Evaluation

R Engineer (English) for AI Model Evaluation

Half of all AI Evaluation & Rating (RLHF) roles come down within 18.5 days of being listed, and 33.6% are still up after four weeks. This one was posted 130 days ago.

About the role

The work

You will evaluate AI-generated responses and create expert R examples that help improve model quality. The work combines code review, applied statistics, data analysis, and careful written judgment.

  • Review responses for accuracy, clarity, prompt adherence, and step-by-step reasoning.
  • Find errors in statistical methods, modeling choices, and data-wrangling workflows.
  • Fact-check analytical results and compare multiple responses for correctness.
  • Write explanations and model solutions that show correct use of R.
  • Create detailed prompts and responses for AI training across varied topics.
  • Test outputs for inaccuracies or bias and assess their reliability across use cases.

What it pays and takes

This is remote, part-time contract work for candidates who can evaluate multiple AI responses and explain their decisions clearly.

  • Pay: Up to $55 per hour.
  • Time: 20+ hours per week.
  • Location: Open to candidates in Bangladesh, Bhutan, Brazil, Cambodia, Germany, India, Indonesia, Malaysia, Nepal, Pakistan, Singapore, Sri Lanka, Thailand, the Philippines, Timor-Leste, the United States, and Vietnam.
  • Language: Excellent written English.
  • Experience: At least two years of hands-on R experience in data analysis, statistics, or data science.
  • R skills: Strong data wrangling, functional programming patterns, and reusable functions or packages.
  • Statistics: Applied knowledge of regression, inference, and model validation.
  • Analysis: Experience completing R projects from data cleaning and exploration through modeling and visualization.
  • Tools: Familiarity with tidyverse, data.table, ggplot2, and large language models used for coding or code review.
  • Education: A bachelor's degree in Statistics, Mathematics, Computer Science, or a closely related quantitative field.

How it works

Apply on OpenTrain with your resume and then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that learn from examples, including reviewing model answers, writing better responses, and checking code or analysis. People with strong technical experience are needed to judge whether outputs are accurate, useful, and well reasoned. OpenTrain helps people find these projects, build a profile, and apply in one place.

Where you can work

This role is 100% remote, for applicants located in these 14 countries: Bangladesh, Bhutan, Germany, Indonesia, India, Cambodia, Sri Lanka, Malaysia, Philippines, Pakistan, Singapore, Thailand, United States and Vietnam.

From OpenTrain AI's job posting, checked 16 Nov 2026.

About OpenTrain AI

A unified board of AI-training jobs with real per-role pay.

How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.

When it pays: When the employer approves each funded milestone. How often others pay

Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new OpenTrain AI roles by email

We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.