Skip to content

AI Evaluation

ML Research Expert — Published First Author (Benchmark Authoring)

AfterQuery logoAfterQuery$150/hrRemote, most countriesContractPosted 2mo ago

Its $150/hr is above the $35/hr median of the AI Evaluation & Rating (RLHF) roles open now, whose typical pay runs $20–$120/hr. How that pay moves week by week is in our research on AI Evaluation & Rating (RLHF) work.

Half of all AI Evaluation & Rating (RLHF) roles come down within 18 days of being listed, and 33.3% are still up after four weeks. This one was posted 60 days ago.

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.

About the role

Paid, remote work authoring and validating research-grade ML benchmark tasks. For Master's or PhD-level ML researchers with at least one first-author paper. Domain: Machine Learning / AI Research Requirements

Experience: 1+ years of hands-on ML research; no upper limit Education: Master's or PhD (in progress is fine, including current PhD candidates)

The work You will design and validate tasks that measure what frontier AI models can actually do across machine learning. We are looking for people who write ML code and publish results, not for annotation or data-labelling experience. Task areas span: Language Models, Deep Learning, Reinforcement Learning, Vision & Generation, Robotics, ML Systems & Efficient ML, Optimization & Theory, Classical & Adaptive Learning, Time Series & Forecasting, Structured & Causal Reasoning, Trustworthy Learning, and AI for Science. Application process Candidates who meet the requirements and provide the requested materials will be prioritised for review. As part of this process we conduct thorough background checks. Please apply only if you meet these requirements.

Responsibilities

  • Design realistic ML research tasks and problem sets within your area of expertise
  • Author expert-level reference solutions and grading rubrics

Required qualifications

  • At least one first-author research paper in machine learning or a closely related field
  • Master's or PhD in ML, CS, statistics, mathematics or a related quantitative field, completed or in progress
  • Hands-on experience writing ML code (training, evaluation or systems work), not annotation or data labelling
  • Meets the experience and education bar described in Full Description

Preferred qualifications

  • Multiple first-author publications, or papers reporting measured improvements over a baseline
  • Publications at venues such as NeurIPS, ICML, ICLR, CVPR, ACL, EMNLP, CoRL or MLSys
  • Depth in one or more of the listed task areas rather than broad familiarity

Why apply

  • Work on frontier AI research problems in your area of deep expertise
  • Fully remote, asynchronous and flexible, 5 to 40 hours a week
  • Competitive hourly compensation ($150)

Where you can work

This role is 100% remote: you can work from any country except Andorra, Afghanistan, Angola, Argentina, Azerbaijan, Barbados, Bangladesh, Burkina Faso, Burundi, Bolivia, Brazil, Belarus, Belize, DR Congo, Central African Republic, Congo (Republic), Chile, Cameroon, China, Colombia, Cuba, Cape Verde, Djibouti, Dominica, Dominican Republic, Egypt, Eritrea, Fiji, Micronesia, Gabon, Grenada, Georgia, Ghana, Gibraltar, Guinea, Equatorial Guinea, Guinea-Bissau, Honduras, Haiti, Iraq, Iran, Japan, Kyrgyzstan, Cambodia, Kiribati, Comoros, St. Kitts and Nevis, North Korea, South Korea, Kazakhstan, Laos, Lebanon, Liberia, Lesotho, Libya, Monaco, Montenegro, Marshall Islands, Mali, Myanmar, Macau, Mauritania, Maldives, Malawi, Niger, Nigeria, Nicaragua, Nepal, Nauru, Papua New Guinea, Palestine, Palau, Paraguay, Russia, Saudi Arabia, Solomon Islands, Seychelles, Sudan, Sierra Leone, San Marino, Somalia, Suriname, South Sudan, São Tomé and Príncipe, Syria, Eswatini, Chad, Togo, Tajikistan, Timor-Leste, Turkmenistan, Tonga, Tuvalu, Ukraine, Uganda, Uruguay, Vatican City, St. Vincent and Grenadines, Venezuela, Vanuatu, Samoa, Yemen, Zambia and Zimbabwe.

From AfterQuery's job posting, checked 14 Nov 2026.

About AfterQuery

Expert reasoning and rubrics for frontier labs, weekly Stripe pay.

How it pays: Every Friday through Stripe, to a bank account in your own name, for the previous week's approved work; AfterQuery takes no fees, cards are not supported, and Stripe holds your first payout for 7 days (its Payments help page, read 13 Nov 2026).

When it pays: Every Friday, through Stripe, for the week before. How often others pay

Interview: on some roles or projects (AfterQuery pool skills assessment (plus an interview step)). Platforms with no interview

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new AfterQuery roles by email

We check the AfterQuery job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.