Skip to content

AI Evaluation

AI Evaluation for Masters/PhD Students in All Disciplines

Its $100/hr is above the $70/hr median of the AI Evaluation & Rating (RLHF) roles open now, whose typical pay runs $35–$130/hr. How that pay moves week by week is in our research on AI Evaluation & Rating (RLHF) work.

Half of all AI Evaluation & Rating (RLHF) roles come down within 18.5 days of being listed, and 33.6% are still up after four weeks. This one was posted 5 days ago.

About the role

The work

You will support AI evaluation research by reviewing content through the standards and technical language of your academic discipline. Your work may include written, visual, diagrammatic, and other subject-specific material.

You will make clear judgments about accuracy, depth, and quality, while identifying errors, unclear points, or gaps that a general reviewer may miss. Each project includes defined annotation and evaluation tasks to complete within its project window.

  • Evaluate written content using the standards and technical vocabulary of your field.
  • Write structured explanations that support your evaluation decisions.
  • Review relevant visual and diagrammatic material, such as schematics, spectra, maps, clinical images, artworks, or data charts.
  • Complete annotation and evaluation tasks within each project window.

What it pays and takes

This is remote, asynchronous, project-based contractor work. You can choose which projects to accept, and the expected commitment is up to 10 hours per week for each project window.

  • $100 per hour.
  • Remote and asynchronous, with up to 10 hours per week for each project window.
  • Open to candidates in the project’s listed countries across Africa, Asia, Europe, North America, South America, and Oceania.
  • Strong written English and the ability to explain nuanced, subject-specific judgments clearly.
  • Current enrollment in a Master's, PhD, MD, or MD/PhD program.
  • Deep familiarity with the visual conventions and technical vocabulary of your academic discipline.
  • Reliable internet access and the ability to work remotely.
  • Helpful background includes visual or image-based research, annotation, data labeling, AI evaluation, multimodal systems, or quantitative methods.
  • Experience with microscopy, imaging, diagrammatic modeling, CAD, GIS, spectroscopy, archival visual materials, large language models, or multimodal AI systems may be useful.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind modern AI systems. People review examples, write and rate responses, assess accuracy, and label information so models can learn how to produce more useful results.

Experienced contributors are paid for applying subject knowledge that helps identify subtle errors and judge quality more accurately than a general reviewer.

Where you can work

This role is 100% remote, for applicants located in these 95 countries: United Arab Emirates, Antigua and Barbuda, Albania, Armenia, Austria, Australia, Bosnia and Herzegovina, Belgium, Bulgaria, Bahrain, Benin, Brunei, Bahamas, Bhutan, Botswana, Canada, Switzerland, Cote d'Ivoire, Costa Rica, Cyprus, Czechia, Germany, Denmark, Algeria, Ecuador, Estonia, Spain, Ethiopia, Finland, France, United Kingdom, Gambia, Greece, Guatemala, Guyana, Hong Kong, Croatia, Hungary, Indonesia, Ireland, Israel, India, Iceland, Italy, Jamaica, Jordan, Kenya, Kuwait, St. Lucia, Liechtenstein, Sri Lanka, Lithuania, Luxembourg, Latvia, Morocco, Moldova, Madagascar, North Macedonia, Mongolia, Malta, Mauritius, Mexico, Malaysia, Mozambique, Namibia, Netherlands, Norway, New Zealand, Oman, Panama, Peru, Philippines, Pakistan, Poland, Portugal, Qatar, Romania, Serbia, Rwanda, Sweden, Singapore, Slovenia, Slovakia, Senegal, El Salvador, Thailand, Tunisia, Türkiye, Trinidad and Tobago, Taiwan, Tanzania, United States, Uzbekistan, Vietnam and South Africa.

From OpenTrain AI's job posting, checked 16 Nov 2026.

About OpenTrain AI

A unified board of AI-training jobs with real per-role pay.

How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.

When it pays: When the employer approves each funded milestone. How often others pay

Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works

Similar open roles

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new OpenTrain AI roles by email

We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.