Skip to content

AI Evaluation

AI Question-and-Answer Evaluation Specialist (English)

The middle of its range, $40/hr, is below the $70/hr median of the AI Evaluation & Rating (RLHF) roles open now, whose typical pay runs $35–$130/hr. How that pay moves week by week is in our research on AI Evaluation & Rating (RLHF) work.

Half of all AI Evaluation & Rating (RLHF) roles come down within 19.5 days of being listed, and 35.5% are still up after four weeks. This one was posted 29 days ago.

About the role

The work

  • Develop original, challenging question-and-answer pairs that test advanced AI models across diverse subjects.
  • Research multiple sources to make answers accurate, complete, and supported by citations.
  • Create multi-step questions that require synthesis and analytical reasoning.
  • Test questions against AI models, analyze the results, and adjust difficulty as needed.
  • Document research methods, citations, and the reasoning behind each answer.
  • Improve content based on reviewer feedback and project quality standards.

What it pays and takes

  • Pay: $20 to $60 per hour equivalent, paid per task that meets the project specifications. Minimum submission requirements apply.
  • The role is remote, contractor-based, and part time, with less than 20 hours per week.
  • Open to candidates in the countries specified for this role.
  • Professional fluency in English is required.
  • Strong independent research, written communication, precise documentation, critical evaluation, and attention to detail are required.
  • You should be able to write nuanced questions, work independently, and take responsibility for your submissions.
  • Prior AI training, evaluation, or content creation experience is helpful but not required.

How it works

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.

About AI training work

AI training is the human work behind artificial intelligence, including writing questions, reviewing model answers, and checking whether information is accurate. People with strong research and evaluation skills are paid to help make AI systems more useful and reliable.

Where you can work

This role is 100% remote, for applicants located in these 48 countries: United Arab Emirates, Argentina, Austria, Bangladesh, Belgium, Bahrain, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, France, United Kingdom, Ghana, Greece, Indonesia, India, Italy, Jordan, Japan, Kenya, Kuwait, Kazakhstan, Sri Lanka, Morocco, Mexico, Malaysia, Nigeria, Netherlands, Oman, Peru, Philippines, Pakistan, Portugal, Qatar, Saudi Arabia, Singapore, Thailand, Tunisia, Taiwan, United States, Uzbekistan, Vietnam and South Africa.

From OpenTrain AI's job posting, checked 19 Nov 2026.

About OpenTrain AI

A unified board of AI-training jobs with real per-role pay.

How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.

When it pays: When the employer approves each funded milestone. How often others pay

Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new OpenTrain AI roles by email

We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.