Emergency Medicine Physician - AI Evaluation

Bring your emergency medicine physician expertise to the development and evaluation of advanced AI systems. You will create realistic clinical cases, evaluate model responses and help establish clinically defensible standards within your specialty.

What You Will Do

Create challenging clinical tasks, longitudinal-chart scenarios, reference answers and evaluation rubrics focused on emergency clinical decision-making, patient safety and emergency-care or EMS handoffs.

Synthesize fragmented records, identify contradictions and missing actions, and assess clinical reasoning, documentation quality and patient safety.

Apply structured rubrics, review specialist feedback and refine cases through calibration cycles.

Review and calibrate contributors’ work, resolve ambiguous clinical or rubric issues and help maintain consistent quality standards.

What You Bring

At least 8 years of relevant professional experience, with current practice or recent practice within the last three years.

An active physician license, board certification or recognized credential appropriate to emergency medicine.

A relevant healthcare degree or equivalent practical experience.

Strong clinical reasoning, chart-review, documentation and written communication skills, with attention to clinically defensible conclusions and patient safety.

Ability to follow standardized rubrics, incorporate critique and work through fast-paced review and calibration cycles.

Nice to Have

Familiarity with US clinical guidelines, payer policies, regulatory requirements and healthcare workflows.

Experience with AI evaluation, clinical content or assessment development, expert review or quality improvement.

Engagement

Remote contractor project for US-based professionals, expected to last 12 weeks. Target start: November 2, 2026.

Part-time (20 hours per week) or full-time (40 hours per week), with four hours of overlap with Pacific working hours.

Selection includes an application review and assessment.

Compensation

USD 135 per hour.

Where you can work

This role is 100% remote, for applicants located in United States.