Radiologist (English) AI Evaluation
Remote in 14 countries
Bangladesh, Bhutan, Germany, Indonesia, India, Cambodia, Sri Lanka, Malaysia, Philippines, Pakistan, Singapore, Thailand, United States, Vietnam
Half of all Law, Medicine & Finance roles come down within 28.7 days of being listed, and 51.1% are still up after four weeks. This one was posted 131 days ago.
About the role
The work
- Review AI-generated radiology and medical-imaging responses for accuracy, clarity, and adherence to the prompt.
- Create detailed prompts and gold-standard answers covering imaging appropriateness, protocols, differential diagnosis, and radiology reporting.
- Evaluate and rank AI responses to improve clinical correctness, safety, clarity, and contextual fit.
- Test AI outputs for unsafe imaging recommendations, inaccuracies, and bias across patient populations and use cases.
- Write precise feedback that explains correct reasoning and better next-step decisions.
What it pays and takes
- Pay: up to $50 to $120 per hour.
- Time: 20+ hours per week.
- Location: Open to candidates in Bangladesh, Bhutan, Brazil, Cambodia, Germany, India, Indonesia, Malaysia, Nepal, Pakistan, Singapore, Sri Lanka, Thailand, the Philippines, the United States, Timor-Leste, and Vietnam.
- Language: C1 English proficiency.
- Required credentials: MD or DO, completed Radiology residency, and board eligibility or certification.
- Experience: At least 5 years of professional radiology experience in academic, community, teleradiology, or subspecialty practice.
- Required knowledge: Strong clinical reasoning for translating clinical presentations into imaging strategy and prioritizing differentials; deep understanding of imaging modalities, tradeoffs, limitations, artifacts, and protocol impacts; and strong safety judgment around contrast reactions, nephrotoxicity, pregnancy, anticoagulation, and radiation dose principles.
- You must have strong attention to detail when fact-checking medical explanations.
- Prior experience with AI data training, report quality assurance, peer review, utilization management, or medical editorial work is strongly preferred.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
OpenTrain is where people find and apply for work that helps build AI systems. AI training uses human review, writing, and feedback to teach models how to produce more accurate and safer results, and experienced specialists are needed for tasks that require professional judgment.
Where you can work
This role is 100% remote, for applicants located in these 14 countries: Bangladesh, Bhutan, Germany, Indonesia, India, Cambodia, Sri Lanka, Malaysia, Philippines, Pakistan, Singapore, Thailand, United States and Vietnam.
From OpenTrain AI's job posting, checked 17 Nov 2026.
About OpenTrain AI
A unified board of AI-training jobs with real per-role pay.
How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.
When it pays: When the employer approves each funded milestone. How often others pay
Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works
Similar open roles
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Prompt & Response Evaluator (opens the job details)
micro1 · AI Evaluation · Remote· 4d agoDetails
$40–$70/hr
Document Annotation Specialist (PDF) (opens the job details)
SuperAnnotate (SME) · Data Annotation · Remote· 6d agoDetails
up to $10/hr
Bilingual Audio Contributor (Romanian/English) (opens the job details)
AfterQuery · Transcription & Audio · Remote· 2mo agoDetails
$30/hr
English Transcribers for AI Training (opens the job details)
Babel Audio · Transcription & Audio · Remote· 1y+ agoDetails
up to $160/audio hr
A licensed or credentialed professional?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new OpenTrain AI roles by email
We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.