Quality Analyst (Non-US) for Chatbot Response Evaluation

The work

You will evaluate AI-generated chatbot responses and decide how well they meet project standards. You will use review guidelines, record evidence for your decisions, and write clear feedback that can help improve chatbot behavior.

The work involves repeated review tasks, so consistency and careful attention to small errors are important.

• Review source materials and chatbot responses against project guidelines.
• Apply evaluation rules and document evidence-based judgments.
• Explain your decisions clearly in written feedback.
• Maintain consistent quality across repeated review tasks.

What it pays and takes

Compensation is handled through the project budget fields for the role, and no specific rate is provided here.

• Time commitment: 20 or more hours per week.
• Schedule: Five working days per week, including weekends as needed, with two weekdays off.
• Location: Open worldwide.
• Language: Professional fluency in English.
• Required background: Experience in quality assurance, data annotation, content evaluation, testing, or similar work.
• Skills: Strong analytical, critical-thinking, problem-solving, written communication, and verbal communication skills.
• Requirements: High attention to detail, the ability to follow detailed instructions, and the ability to identify subtle errors.
• Tools: Comfort working with AI tools, chatbots, and online platforms.
• Work style: Ability to work independently and manage multiple tasks.
• Helpful experience: Chatbot evaluation, large language model testing, or data-quality projects.

How it works

Apply on OpenTrain with your resume and then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that generate and understand text, images, audio, and code. People review examples, rate model responses, and explain errors so AI systems can improve, with experienced reviewers valued for careful judgment and subject knowledge.

Where you can work

This role is 100% remote: you can work from any country except Andorra, Afghanistan, Barbados, Burkina Faso, Burundi, Brazil, Belarus, Belize, DR Congo, Central African Republic, Congo (Republic), Cameroon, China, Cuba, Cape Verde, Djibouti, Dominica, Eritrea, Fiji, Micronesia, Grenada, Georgia, Guinea, Equatorial Guinea, Guinea-Bissau, Honduras, Haiti, Iraq, Iran, Kyrgyzstan, Kiribati, Comoros, St. Kitts and Nevis, North Korea, Lebanon, Liberia, Lesotho, Libya, Montenegro, Marshall Islands, Mali, Myanmar, Mauritania, Maldives, Malawi, Nicaragua, Nepal, Nauru, Papua New Guinea, Palestine, Palau, Russia, Solomon Islands, Seychelles, Sudan, Sierra Leone, Somalia, Suriname, South Sudan, São Tomé and Príncipe, Syria, Eswatini, Chad, Togo, Tajikistan, Timor-Leste, Turkmenistan, Tonga, Tuvalu, Ukraine, Uganda, Vatican City, St. Vincent and Grenadines, Venezuela, Vanuatu, Samoa, Yemen, Zambia and Zimbabwe.