Generalist
Half of all AI Evaluation & Rating (RLHF) roles come down within 18 days of being listed, and 33.3% are still up after four weeks. This one was posted 2 days ago.
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.
About the role
What the work looks like
AI models that read images are often bad at counting, and they get worse when counting takes reasoning. You'll build tasks that expose that weakness:
\- Taking your own original, unedited photos of real-world scenes, mainly outdoor ones (streets, parking lots, building facades, parks, markets) that hold many countable objects
\- Writing 3–5 counting prompts per image that make the model reason, not just count: conditional filters ("How many red cars are parked in the lot?"), purpose-based reasoning ("How many objects require seatbelts to operate?"), spatial relationships ("How many cars are parked next to an empty space?"), telling similar objects apart, and prompts whose correct answer is 0
\- Making sure every prompt has exactly one correct answer that 9 out of 10 people would agree on right away, then checking and recording that answer
\- Outlining (masking) every counted object in an annotation tool so each answer can be checked object by object
\- Aiming for image and prompt sets where the model gets the count wrong
Pay is per task, based on how many objects your hardest prompt counts: $60 (0–24 objects), $70 (25–49), $80 (50–79), $100 (80+).
What we're looking for
\- A sharp eye for detail, and the patience to count dozens of objects accurately
\- A phone or camera, and access to busy real-world scenes you can photograph yourself
\- Clear, precise writing: prompts can't use vague terms like "closest" or shades of color that people would argue about
\- Comfort with careful, repetitive checking, and acting on reviewer feedback
\- Willingness to flag unclear guidelines rather than guess
What this covers
\- Original photography of natural, unedited scenes (no stock, social media, AI-generated, or edited images)
\- Writing reasoning-based counting prompts: conditional, spatial, comparing similar objects, crowded scenes, and zero-answer prompts
\- Outlining (masking) objects and checking each answer
\- Strong reviewers may be promoted to review other people's tasks as the project goes on
Your photos matter more than your background. A strong submission is an original, busy scene with prompts the model can't answer correctly.
How it works
1\. Apply with your resume and confirm where you work from.
2\. Complete the short assessment attached to this listing. It's required to be considered for this project.
3\. We review your profile and assessment results. If you look like a good fit, we'll reach out with next steps.
4\. Once you're onboarded, you'll read the project guidelines, watch the onboarding call, pass the onboarding quiz, and submit one qualifying task (it must be an outdoor photo). After it's approved, you can claim more tasks.
What to expect
Applying doesn't guarantee a spot on the project. We'll contact you only if your profile and assessment are a good match, and timing depends on the project's needs.
Once you're on the project, it's pay-per-task with flexible hours, so you choose how many tasks you take on. Every image goes through an originality check before you can submit it, and each task is reviewed for accuracy. A task that's sent back for edits reduces your pay for it, so careful first submissions pay best.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Where you can work
This role is 100% remote: you can work from any country except Andorra, Afghanistan, Armenia, Azerbaijan, Barbados, Burkina Faso, Burundi, Bahamas, Bhutan, Belarus, Belize, DR Congo, Central African Republic, Congo (Republic), Cameroon, China, Cuba, Cape Verde, Djibouti, Dominica, Eritrea, Ethiopia, Fiji, Micronesia, Grenada, Georgia, Guinea, Equatorial Guinea, Guinea-Bissau, Honduras, Haiti, Iraq, Iran, Kenya, Kyrgyzstan, Cambodia, Kiribati, Comoros, St. Kitts and Nevis, North Korea, Kazakhstan, Lebanon, Liechtenstein, Liberia, Lesotho, Libya, Moldova, Montenegro, Marshall Islands, Mali, Myanmar, Mauritania, Maldives, Malawi, Niger, Nicaragua, Nauru, Papua New Guinea, Pakistan, Palestine, Palau, Russia, Solomon Islands, Seychelles, Sudan, Sierra Leone, Somalia, Suriname, South Sudan, São Tomé and Príncipe, Syria, Eswatini, Chad, Togo, Tajikistan, Timor-Leste, Turkmenistan, Tonga, Tuvalu, Ukraine, Uganda, Vatican City, St. Vincent and Grenadines, Venezuela, Vanuatu, Samoa, Yemen, Zambia and Zimbabwe.
From Mercor's job posting, checked 14 Nov 2026.
About Mercor
Premium expert network: physicians, lawyers, engineers, PhDs.
How it pays: Weekly via Stripe (1099 contractors).
When it pays: Every Wednesday, for the week before. How often others pay
Interview: yes, for everyone it takes (AI Video Interview (plus role-specific assessments)). How the Mercor AI interview works
Similar open roles
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

AI Conversation Evaluator (opens the job details)
micro1 · AI Evaluation · Remote· 1d agoDetails
$40–$70/hr
Document Annotation Specialist (PDF) (opens the job details)
SuperAnnotate (SME) · Data Annotation · Remote· 3d agoDetails
up to $10/hr
Students Across All Disciplines (Undergrad) (opens the job details)
AfterQuery · Domain Experts · Remote· 5mo agoDetails
$100/hr
Babel Audio · Transcription & Audio · Remote· 5mo agoDetails
up to $110/audio hr
Want companies to ask for you?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new Mercor roles by email
We check the Mercor job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.