AI Conversation Evaluator (English)
Remote in 48 countries
United Arab Emirates, Argentina, Austria, Bangladesh, Belgium, Bahrain, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, France, United Kingdom, Ghana, Greece, Indonesia, India, Italy, Jordan, Japan, Kenya, Kuwait, Kazakhstan, Sri Lanka, Morocco, Mexico, Malaysia, Nigeria, Netherlands, Oman, Peru, Philippines, Pakistan, Portugal, Qatar, Saudi Arabia, Singapore, Thailand, Tunisia, Taiwan, United States, Uzbekistan, Vietnam, South Africa
The middle of its range, $55/hr, is below the $70/hr median of the AI Evaluation & Rating (RLHF) roles open now, whose typical pay runs $35–$130/hr. How that pay moves week by week is in our research on AI Evaluation & Rating (RLHF) work.
Half of all AI Evaluation & Rating (RLHF) roles come down within 18.5 days of being listed, and 33.6% are still up after four weeks. This one was posted 3 days ago.
About the role
The work
You will test different AI assistants through natural, multi-turn conversations and judge how well they handle everyday requests. Your feedback will help improve how conversational AI responds to people.
Use practical scenarios such as writing, trip planning, research, brainstorming, and general questions. Compare responses, rate their quality, and record clear reasons for your judgments.
- Have conversations with different AI assistants using practical, everyday scenarios.
- Compare responses and identify which experience is more helpful and satisfying.
- Rate clarity, tone, helpfulness, overall quality, and user satisfaction.
- Flag responses that feel unnatural, repetitive, or unnecessary.
- Write brief feedback about positive and negative moments.
- Follow testing guidelines and document evaluations accurately.
What it pays and takes
This is a remote, part-time contractor project for experienced users of conversational AI. No coding, specific professional background, or previous AI evaluation experience is required.
- Pay: $40 to $70 per hour.
- Project dates: November 15 through November 18.
- Time: Approximately 7.5 hours total.
- Location: Remote and available to eligible candidates in the countries supported for this project, including the United States, Canada, the United Kingdom, India, Japan, and others.
- Language: Clear written communication and fluency in English.
- Requirement: Use ChatGPT at least three times per week and have an active personal ChatGPT Free or Plus account.
- Skills: Comfort using AI assistants for everyday tasks, strong attention to detail, and the ability to follow instructions.
How it works
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 7 screening questions.
About AI training work
AI training is the human work behind systems that learn to understand and answer people. Contributors review model responses, compare different outputs, and explain what makes an answer useful, clear, and natural. OpenTrain helps people find these projects, build a profile, and apply in minutes.
Where you can work
This role is 100% remote, for applicants located in these 48 countries: United Arab Emirates, Argentina, Austria, Bangladesh, Belgium, Bahrain, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, France, United Kingdom, Ghana, Greece, Indonesia, India, Italy, Jordan, Japan, Kenya, Kuwait, Kazakhstan, Sri Lanka, Morocco, Mexico, Malaysia, Nigeria, Netherlands, Oman, Peru, Philippines, Pakistan, Portugal, Qatar, Saudi Arabia, Singapore, Thailand, Tunisia, Taiwan, United States, Uzbekistan, Vietnam and South Africa.
From OpenTrain AI's job posting, checked 16 Nov 2026.
About OpenTrain AI
A unified board of AI-training jobs with real per-role pay.
How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.
When it pays: When the employer approves each funded milestone. How often others pay
Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works
Similar open roles
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Open Source GitHub Maintainer Code Review (opens the job details)
OpenTrain AI · Coding · Remote· 1mo agoDetails
$120–$200/hr
CBRN Specialist (AI Safety Review) (opens the job details)
OpenTrain AI · Red-Teaming · Remote· 2mo agoDetails
up to $60–$100/hr
Full-Stack Engineer (opens the job details)
OpenTrain AI · Coding · Remote· 2mo agoDetails
$50–$100/hr
Investment Bankers Financial Analysis Reviewer (opens the job details)
OpenTrain AI · Domain Experts · Remote· 1mo agoDetails
up to $175/hr
AI Conversation Evaluator (opens the job details)
micro1 · AI Evaluation · Remote· 3d agoDetails
$40–$70/hr
Want companies to ask for you?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new OpenTrain AI roles by email
We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.