Skip to content

Domain Experts

Resident Medical Specialist (MD/DO) AI Evaluator

OpenTrain AI logoOpenTrain AI~$65–$175/hrtypicalRemote, most countriesContractPosted 3mo ago

Half of all Law, Medicine & Finance roles come down within 28.5 days of being listed, and 50.2% are still up after four weeks. This one was posted 108 days ago.

About the role

The work

  • Evaluate how medical AI systems handle clinical reasoning and decision-making.
  • Design structured evaluation frameworks for medical AI systems.
  • Create clinical scenarios that test AI reasoning and clinical decisions.
  • Build assessments that reflect the complexity of real clinical practice.
  • Identify gaps in the medical knowledge and reasoning shown by AI systems.
  • Work with AI research teams to improve model performance.
  • The role title names a Resident Medical Specialist (MD/DO), while the work description focuses on medical AI clinical reasoning evaluation; review the duties and qualifications before applying.

What it takes

  • Pay is not provided in the listing.
  • Remote worldwide engagement with flexible scheduling around clinical commitments.
  • Part-time contract work requiring 20+ hours per week.
  • The initial engagement lasts 1 month, with potential extensions based on performance and fit.
  • You must be a licensed physician in active clinical practice with experience in clinical decision-making and evidence-based medicine.
  • Professional fluency in English is required.
  • Experience in pediatrics, emergency medicine, obstetrics and gynecology, gynecologic oncology, public health, or another clinical specialty can support the work.
  • Strong analytical, communication, critical-thinking, problem-solving, and medical AI skills are needed.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that learn from examples, including clinical scenarios and reviewed model responses. Medical specialists are paid for applying their subject knowledge to judge whether AI outputs are accurate, safe, and useful.

Where you can work

This role is 100% remote: you can work from any country except Andorra, Afghanistan, Barbados, Burkina Faso, Burundi, Brazil, Belarus, Belize, DR Congo, Central African Republic, Congo (Republic), Cameroon, China, Cuba, Cape Verde, Djibouti, Dominica, Eritrea, Fiji, Micronesia, Grenada, Georgia, Guinea, Equatorial Guinea, Guinea-Bissau, Honduras, Haiti, Iraq, Iran, Kyrgyzstan, Kiribati, Comoros, St. Kitts and Nevis, North Korea, Lebanon, Liberia, Lesotho, Libya, Montenegro, Marshall Islands, Mali, Myanmar, Mauritania, Maldives, Malawi, Nicaragua, Nepal, Nauru, Papua New Guinea, Palestine, Palau, Russia, Solomon Islands, Seychelles, Sudan, Sierra Leone, Somalia, Suriname, South Sudan, São Tomé and Príncipe, Syria, Eswatini, Chad, Togo, Tajikistan, Timor-Leste, Turkmenistan, Tonga, Tuvalu, Ukraine, Uganda, Vatican City, St. Vincent and Grenadines, Venezuela, Vanuatu, Samoa, Yemen, Zambia and Zimbabwe.

From OpenTrain AI's job posting, checked 19 Nov 2026.

About OpenTrain AI

A unified board of AI-training jobs with real per-role pay.

How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.

When it pays: When the employer approves each funded milestone. How often others pay

Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

A licensed or credentialed professional?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new OpenTrain AI roles by email

We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.