AI Product Evaluator
The middle of its range, $25/hr, is below the $70/hr median of the AI Evaluation & Rating (RLHF) roles open now, whose typical pay runs $35–$130/hr. How that pay moves week by week is in our research on AI Evaluation & Rating (RLHF) work.
Half of all AI Evaluation & Rating (RLHF) roles come down within 18.5 days of being listed, and 33.6% are still up after four weeks. This one was posted 30 days ago.
About the role
The work
You will test AI models and agents by following detailed scenarios and project guidelines. Your evaluations will examine accuracy, reasoning, and responsiveness, with results recorded for AI training work.
- Evaluate AI models and agents against defined scenarios.
- Carry out operational tasks that test accuracy and reasoning.
- Record findings, observations, and unusual results in structured reports.
- Reset usage limits and repeat evaluations according to project instructions.
- Record and submit evaluation datasets on AI training platforms.
- Maintain careful, consistent work during repetitive or high-volume tasks.
What it pays and takes
The role suits people who can follow detailed instructions accurately and stay thorough during repeated tasks.
- Pay: $14 to $36 per hour, depending on experience.
- Work type: Remote, part-time contract.
- Location: Open to candidates in India, Japan, or the United Kingdom.
- Language: Professional fluency in English.
- Experience: Experience with AI products, models, or AI agent evaluation and testing.
- Follow complex instructions with precision and consistency.
- Show exceptional attention to detail and operational thoroughness.
- Work comfortably within strict timeframes during repetitive or high-volume tasks.
- Helpful background: Digital product testing, software quality assurance, or AI research.
- Helpful background: Regular daily use of AI tools and models.
How it works
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 7 screening questions.
About AI training work
AI training work is the human side of building artificial intelligence. People evaluate model responses, prepare examples, and review results so AI systems can become more accurate and useful; specialized experience can support higher pay.
Where you can work
This role is 100% remote, for applicants located in United Kingdom, India and Japan.
From OpenTrain AI's job posting, checked 16 Nov 2026.
About OpenTrain AI
A unified board of AI-training jobs with real per-role pay.
How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.
When it pays: When the employer approves each funded milestone. How often others pay
Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works
Similar open roles

Open Source GitHub Maintainer Code Review (opens the job details)
OpenTrain AI · Coding · Remote· 1mo agoDetails
$120–$200/hr
CBRN Specialist (AI Safety Review) (opens the job details)
OpenTrain AI · Red-Teaming · Remote· 2mo agoDetails
up to $60–$100/hr

SaaS Contracts Counsel (Technology Transactions) (opens the job details)
OpenTrain AI · Domain Experts · Remote· 1mo agoDetails
$80–$110/hr
Language Expert (Korean Audio Transcription) (opens the job details)
OpenTrain AI · Transcription & Audio · Remote· 1mo agoDetails
$20–$36/hr
Want companies to ask for you?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new OpenTrain AI roles by email
We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.