Skip to content

AI Evaluation

Quality Analyst - US

Turing logoTuringRemote in United StatesContractPosted 3w ago

Half of all AI Evaluation & Rating (RLHF) roles come down within 18.5 days of being listed, and 33.6% are still up after four weeks. This one was posted 23 days ago.

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.

About the role

About Turing

Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Role Overview

We are looking for a detail-oriented QA Analyst to evaluate and compare responses generated by multiple chatbots. The role involves reviewing outputs against defined guidelines, identifying inaccuracies or quality issues, and providing a clear final assessment for each evaluation task.

Key Responsibilities

  • Evaluate and compare responses generated by multiple chatbots.
  • Assess responses for accuracy, relevance, completeness, clarity, and adherence to guidelines.
  • Identify errors, inconsistencies, missing information, and potential quality issues.
  • Provide structured feedback and final assessments for each task.
  • Follow evaluation guidelines and maintain consistency across all reviews.
  • Document findings clearly and accurately.
  • Collaborate with project and quality teams to resolve queries.
  • Meet assigned productivity, quality, and turnaround-time targets.
  • Escalate complex or ambiguous cases when necessary.

Required Qualifications

  • Experience in Quality Assurance, data annotation, content evaluation, testing, or a similar role.
  • Strong analytical, critical-thinking, and problem-solving skills.
  • Excellent written and verbal communication skills.
  • High attention to detail and ability to identify subtle errors.
  • Comfortable working with AI tools, chatbots, and online platforms.
  • Prior experience with chatbot evaluation, LLM testing, or data-quality projects is an advantage.

Perks of Freelancing With Turing

  • Work at the forefront of AI applications in accounting and finance.
  • Fully remote and flexible work environment.
  • Opportunity to collaborate on high-impact projects with global reach.

Offer Details

  • This is a project-based role involving a defined number of evaluation tasks.
  • Each task will involve comparing multiple chatbots and providing a final assessment.
  • Work Schedule: Five working days per week, including weekends as required, with two weekdays off.
  • Duration: 16 weeks.

Where you can work

This role is 100% remote, for applicants located in United States.

From Turing's job posting, checked 11 Nov 2026.

About Turing

Coding-and-reasoning data for frontier labs, heavy vetting.

How it pays: Monthly for the hours your manager approves: processed by the 5th business day of the following month into a USD wallet (Airwallex) on Turing's portal and withdrawn by bank transfer, or through Deel depending on the project (Project Onboarding, read 6 Nov 2026).

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new Turing roles by email

We check the Turing job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.