Skip to content

AI Evaluation

LLM Evaluation Analyst (English)

OpenTrain AI logoOpenTrain AI~$50–$145/hrtypicalRemote, most countriesContractPosted 3w ago

Half of all AI Evaluation & Rating (RLHF) roles come down within 18.5 days of being listed, and 33.6% are still up after four weeks. This one was posted 22 days ago.

About the role

The work

You will evaluate written content and large language model outputs to help improve how models reason and answer questions. The work combines text review, research, logical problem solving, feedback, and careful judgment.

  • Read, summarize, and divide large pieces of content into smaller logical sections.
  • Answer analytical questions and create scenarios that reveal weaknesses in model reasoning.
  • Research information online and validate claims made in written content.
  • Correct inaccurate model answers and explain the reasoning behind accurate answers.
  • Analyze examples such as sales trends across locations and rule-based logic problems.
  • Provide constructive feedback and detailed annotations focused on text accuracy and formatting.

What it pays and takes

The work requires strong English reading and writing skills, analytical judgment, and the ability to work independently.

  • Pay: Not provided in the role details.
  • Time: 20+ hours per week.
  • Location: Open worldwide.
  • Language: High-level English reading and writing comprehension.
  • Skills: Research, analytical thinking, logical reasoning, basic arithmetic, creative thinking, and clear explanations.
  • Helpful experience: Quality assurance, data annotation, content review, professional writing, research analysis, journalism, editing, translation, communications, literature, arts, engineering, or statistics.
  • Tools and setup: Familiarity with Excel and Google Suite, plus a reliable computer and internet connection.
  • Helpful education: Undergraduate study or a bachelor's degree in an analytical, writing, communications, or technical field.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind artificial intelligence, including reviewing model answers, checking facts, and giving feedback that helps systems improve. People with strong writing, research, and subject knowledge help models produce more accurate and useful results.

Where you can work

This role is 100% remote: you can work from any country except Andorra, Afghanistan, Barbados, Burkina Faso, Burundi, Brazil, Belarus, Belize, DR Congo, Central African Republic, Congo (Republic), Cameroon, China, Cuba, Cape Verde, Djibouti, Dominica, Eritrea, Fiji, Micronesia, Grenada, Georgia, Guinea, Equatorial Guinea, Guinea-Bissau, Honduras, Haiti, Iraq, Iran, Kyrgyzstan, Kiribati, Comoros, St. Kitts and Nevis, North Korea, Lebanon, Liberia, Lesotho, Libya, Montenegro, Marshall Islands, Mali, Myanmar, Mauritania, Maldives, Malawi, Nicaragua, Nepal, Nauru, Papua New Guinea, Palestine, Palau, Russia, Solomon Islands, Seychelles, Sudan, Sierra Leone, Somalia, Suriname, South Sudan, São Tomé and Príncipe, Syria, Eswatini, Chad, Togo, Tajikistan, Timor-Leste, Turkmenistan, Tonga, Tuvalu, Ukraine, Uganda, Vatican City, St. Vincent and Grenadines, Venezuela, Vanuatu, Samoa, Yemen, Zambia and Zimbabwe.

From OpenTrain AI's job posting, checked 16 Nov 2026.

About OpenTrain AI

A unified board of AI-training jobs with real per-role pay.

How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.

When it pays: When the employer approves each funded milestone. How often others pay

Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works

Similar open roles

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new OpenTrain AI roles by email

We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.