Skip to content

AI Evaluation

Domain Expert, AI Evaluation (US)

Handshake AI logoHandshake AIup to $200/hrRemote in United StatesPart-timePosted today

Half of all AI Evaluation & Rating (RLHF) roles come down within 19.5 days of being listed, and 35.5% are still up after four weeks. This one was posted today.

About the role

Overview

Handshake is recruiting Master's and PhD holders residing in the United States to partner with leading AI labs and join our AI research community. This program brings subject-matter experts together to enhance the capabilities of Large Language Models (LLMs) across specialized scientific and technical domains. The Handshake AI Fellowship program runs year-round, though project availability will vary by discipline.

Details

  • The position is remote and asynchronous - work independently from wherever you are.
  • Flexible hours and the ability to work remotely, with a commitment of approximately 5 to 20 hours per week.
  • Project work includes, but is not limited to, writing and solving challenging problems in your area of expertise, developing domain-specific prompts and evaluating LLM responses for correctness and quality of reasoning.
  • Dedicate time researching topics that are interesting to you, with the assistance of AI.
  • Learn new skills while contributing to the changing world of AI across various disciplines.
  • Placement into a project will be dependent on project availability. You'll apply once and, if qualified, be considered for projects as they open.

Qualifications

  • Education : PhD students and graduates (including those currently enrolled in a PhD program or in postdoctoral positions), or Master’s degree holders with relevant experience, in Mathematics, Chemistry, Biology, Physics, Engineering, Computer Science, Medicine, etc.
  • Experience : 2+ years of research or industry experience in your field, in addition to your degree
  • Subject expertise : Deep subject knowledge and careful attention to detail, and confidence that your domain expertise can outmatch current AI systems in understanding and explaining key concepts in your field
  • Written communication : Strong written communication, with the ability to translate complex research knowledge into clear, structured task instructions and evaluation criteria

Required for all applicants

  • Must be based in the United States and have US work authorization
  • Ability to work independently in a remote, asynchronous environment
  • Availability of approximately 5 to 20 hours per week

Where you can work

This role is 100% remote, for applicants located in United States.

From Handshake AI's job posting, checked 19 Nov 2026.

About Handshake AI

Degree-holding US trainers, with hourly contract roles on its live board.

How it pays: Weekly through Stripe (set up in Handshake AI): Handshake sends each Monday-to-Sunday week's pay to its pay partners by Wednesday afternoon; a W-9 or W-8BEN is required (Handshake AI support, read 2026-10-14).

When it pays: Each Monday-to-Sunday week, sent to its payout partners by Wednesday. How often others pay

Interview: none to get in (Project assessment (per project, after an invitation)). Platforms with no interview

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new Handshake AI roles by email

We check the Handshake AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.