Physics LLM Evaluation Expert (Ph.D. / Postdoc / Master’s)
Half of all Math & STEM roles come down within 27.1 days of being listed, and 45.6% are still up after four weeks. This one was posted 124 days ago.
About the role
The work
- Design and solve difficult STEM problems that test the limits of large language models.
- Write clear, step-by-step solutions with detailed reasoning.
- Work with LLM researchers to align problems with evaluation goals.
- Help create evaluation benchmarks based on physics curricula from early undergraduate through Ph.D. level.
- Explain complex STEM ideas in simple, precise language.
- Provide detailed annotations and constructive feedback on model outputs.
What it takes
- Expert-level experience or study consistent with graduate, Ph.D., or postdoctoral STEM work.
- Strong analytical and research skills, with solid knowledge of physics, mathematics, and related sciences.
- Excellent English comprehension and structured communication skills.
- Ability to work independently in a remote setting for 20+ hours per week.
- This is a worldwide, remote, contract and part-time role.
- Helpful background includes applied physics or a related STEM specialization, plus experience explaining complex physics concepts with simple language, visuals, and reasoning.
- Comfort with abstraction, symbolic manipulation, and other multi-step reasoning tasks.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training work uses human-written examples, ratings, and feedback to improve how artificial intelligence systems respond. OpenTrain helps people find these projects, build a profile, and apply through one account.
Specialist contributors are needed for tasks such as physics problem design and model evaluation because their subject knowledge helps make AI systems more accurate and useful.
Where you can work
This role is 100% remote: you can work from any country except Andorra, Afghanistan, Barbados, Burkina Faso, Burundi, Brazil, Belarus, Belize, DR Congo, Central African Republic, Congo (Republic), Cameroon, China, Cuba, Cape Verde, Djibouti, Dominica, Eritrea, Fiji, Micronesia, Grenada, Georgia, Guinea, Equatorial Guinea, Guinea-Bissau, Honduras, Haiti, Iraq, Iran, Kyrgyzstan, Kiribati, Comoros, St. Kitts and Nevis, North Korea, Lebanon, Liberia, Lesotho, Libya, Montenegro, Marshall Islands, Mali, Myanmar, Mauritania, Maldives, Malawi, Nicaragua, Nepal, Nauru, Papua New Guinea, Palestine, Palau, Russia, Solomon Islands, Seychelles, Sudan, Sierra Leone, Somalia, Suriname, South Sudan, São Tomé and Príncipe, Syria, Eswatini, Chad, Togo, Tajikistan, Timor-Leste, Turkmenistan, Tonga, Tuvalu, Ukraine, Uganda, Vatican City, St. Vincent and Grenadines, Venezuela, Vanuatu, Samoa, Yemen, Zambia and Zimbabwe.
From OpenTrain AI's job posting, checked 18 Nov 2026.
About OpenTrain AI
A unified board of AI-training jobs with real per-role pay.
How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.
When it pays: When the employer approves each funded milestone. How often others pay
Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works
Similar open roles
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Prompt & Response Evaluator (opens the job details)
micro1 · AI Evaluation · Remote· 6d agoDetails
$40–$70/hr
Document Annotation Specialist (PDF) (opens the job details)
SuperAnnotate (SME) · Data Annotation · Remote· 1w agoDetails
up to $10/hr

General AfterQuery Expert (Data Annotator) (opens the job details)
AfterQuery · Data Annotation · Remote· 1y+ agoDetails
$43/hr
A degree in math or science?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new OpenTrain AI roles by email
We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.