For companies building AI
Expert data for your AI, from US professionals.
Evaluations, rubrics, fine-tuning data, RL environments and red-teaming, done by doctors, nurses, lawyers, finance professionals, scientists and engineers from our own network. We plan the project, staff it, check the work and deliver it, end to end.
Only need the experts, to contract them yourself? We find the experts: we find and assess the experts your work needs and introduce the ones who said yes. You contract them yourself.
What we deliver
Expert work your AI is built and judged on
Expert evaluation
Professionals grade an AI system's answers against the standards of their field, before launch and while it runs.
Rubrics and grading criteria
Professionals write what a correct, complete and safe answer must contain, item by item, so a model or a grader can be scored.
Preference and comparison data
Professionals compare answers and say which is better and why, for training by human feedback.
Fine-tuning data
Professionals write the questions and model answers a domain model is trained on, from real work in their field.
RL environments and tasks
Professionals turn real work into tasks an AI agent attempts, with reference solutions and graders.
Red-teaming
Professionals try to make an AI system fail in the ways that matter in their field, and write down how.
Benchmarks
Professionals write and review the hard questions a field's benchmark is made of.
Our network
The professionals behind the work
Professionals with a profile in our network, by their main field, and how many of them are in the United States. 114 have also been assessed in a spoken interview.
- Health and medicine652 (110 US)
- Law149 (25 US)
- Finance, accounting and insurance354 (61 US)
- Science, math and engineering625 (67 US)
- Software engineering1,170 (164 US)
- Teaching135 (13 US)
- Languages and translation965 (54 US)
- Writing and editing420 (37 US)
Who it is for
Teams whose AI has to be right in a field
Enterprises in regulated fields
Banks, insurers, health systems, pharma, law and accounting firms build their own AI and must show it was checked by people qualified in the field.
Sovereign and public-sector AI
Governments and their contractors build national and agency models that need expert evaluation and red-teaming.
AI companies built for one industry
Health, legal, finance and science AI companies hire experts as contractors themselves and cannot staff enough of them.
Evaluation and RL-environment studios
They sell expert-built evaluations and environments to labs and say they have more demand than experts.
Model labs
Smaller and newer labs run vendor selection openly; the largest labs have settled vendor networks and come later.
Enterprise AI platforms and integrators
The platforms and consultancies that build enterprises' AI need domain experts for their clients' projects.
How it works
From your brief to delivered work
Tell us what your AI needs
The field, the kind of expert work, how much of it and when, and anything about the data. A short chat or an email is enough.
We plan it from our own network
The experts we would put on it, with their credentials and how we assessed them, how the work is checked, and a first batch with what counts as accepted written down.
A paid first batch
Done and checked against the agreed standard, priced as the full project will be, so you judge real work before you commit to more.
The work runs, checked and delivered
In your tools or ours, reviewed before it reaches you, delivered and invoiced on the schedule you set, with one contact for the whole project.
For you
What we commit to
- Experts chosen for the work from a network we already know: their profile, their credentials checked against public registries, their assessments and their availability.
- A paid first batch, with what counts as accepted written down before it starts, priced as the full project will be.
- Experts paid for every hour of the work, onboarding and calibration included, so the best stay.
- A client's data and instructions are used for that client's project only.
- Every expert on a project has accepted written confidentiality and assigns their work product to the client.
- Health data that identifies a person is handled only under a signed business associate agreement.
- The first batch is paid and priced as the full project will be, with what counts as accepted agreed before it starts.
For the experts
How we treat the people doing the work
- Every hour the project asks of the expert is paid: onboarding, training, calibration and trial work included.
- Experts choose their own hours inside the project's delivery window; no screenshots, screen recording or activity tracking.
- The pay, the expected hours and the terms are written down before anyone accepts, and never lowered during the project.
- Work judged not accepted is explained in writing, and the expert can answer it and have it looked at again by a different reviewer.
- Pay goes out on a fixed schedule written in the project terms.
The terms every expert accepts are public: expert terms.
Questions
What teams ask us
Are you a recruiting agency or a staffing firm?
No. We deliver the work: we plan the project, put experts from our own network on it, check what they produce and deliver it to you. You deal with one company for the whole project, not with the experts one by one.
Where do your experts come from?
From AITraining.jobs, the site US professionals use to find paid AI training work. 6,008 professionals have a profile with us, 678 of them in the United States. We read each profile, check credentials against public registries where they exist (the NPI registry for clinicians, state bar records for attorneys), assess people in a spoken interview, and know who is available now. For a field we are short of, we recruit the professionals the project needs.
How do you check the quality of the work?
Against a written standard agreed with you before the first batch: a reviewer from the same field checks the work, with test items whose correct answers are known, and anything that misses the standard is redone before it reaches you. You see the checks, not only the result.
How is it priced?
Per project, by the hour or by the task, quoted once we have scoped your brief: the experts it needs, how scarce they are and the volume. The first batch is priced as the full project will be.
What about our data and confidentiality?
Your data and instructions are used for your project only. Every expert on it has accepted written confidentiality and assigns their work to you. Health data that identifies a person is handled only under a signed business associate agreement.
Can the experts work in our own tools?
Yes. Most projects run in the client's own labeling or evaluation tool; where you have none, we provide one.
Why would experts choose to work through you?
Because we pay for every hour a project asks of them, onboarding and calibration included, never track their screens, write the pay and the terms down before they accept, and let them answer any review of their work. The best experts have many offers; this is how we keep them.
Tell us what your AI needs
A short chat. We reply with the experts we would put on it, how we would check the work and a plan for the first batch. Or have us find the experts for you to contract yourself.
We find the experts
We find and assess the experts your work needs and introduce the ones who said yes. You contract them yourself.
A fee per expert you accept.
We run the project
We staff, run, review and deliver the expert work your AI needs, with professionals from our own network.
Priced per project.
Talk to Yuma Heymans, Founder & CEO of AITraining.jobs.
Founder and CEO of AITraining.jobs and co-founder of the AI recruitment platform HeroHunt.ai, based in San Francisco, with years spent mapping how AI-training and data work is sourced, staffed, and paid.