Skip to content

AI Evaluation

AI Workflow Evaluation Generalist

OpenTrain AI logoOpenTrain AI$30–$49/hrRemote in United StatesContractPosted 3w ago

The middle of its range, $39.50/hr, is below the $70/hr median of the AI Evaluation & Rating (RLHF) roles open now, whose typical pay runs $35–$130/hr. How that pay moves week by week is in our research on AI Evaluation & Rating (RLHF) work.

Half of all AI Evaluation & Rating (RLHF) roles come down within 18.5 days of being listed, and 33.6% are still up after four weeks. This one was posted 24 days ago.

About the role

The work

You will complete practical workflows across online platforms, products, and services while using AI tools. You will then assess the results and explain what worked, what failed, and what could be improved.

Some assignments may involve purchasing, payment, or cancellation activities. You will document the work with screenshots and written observations, then submit clear feedback about errors, inconsistencies, usability problems, and AI accuracy.

  • Complete real-world workflows on online platforms, products, and services.
  • Use AI tools to carry out assigned tasks and evaluate their performance.
  • Complete purchasing, payment, and cancellation workflows when project guidelines require them.
  • Capture task execution with screenshots and written observations.
  • Identify errors, inconsistencies, and usability issues in AI-generated results.
  • Provide structured feedback that can improve AI accuracy and practical performance.
  • Manage multiple assignments independently while maintaining quality standards.

What it pays and takes

This is an entry-level, part-time contractor role for candidates in the United States. Relevant experience can help, but the work also depends on practical digital skills, careful documentation, and regular availability.

  • Pay: $30 to $49 per hour.
  • Location: Open to candidates in the United States.
  • Work type: Part-time contract work.
  • Language: Professional fluency in English.
  • Experience level: Entry level.
  • Hands-on experience using AI tools and strong digital literacy.
  • Confidence navigating online platforms and applications.
  • Strong written communication and documentation skills.
  • Ability to work independently, manage multiple assignments, and maintain regular availability.
  • Fingerprint or facial-recognition biometrics available on a laptop or mobile device for secure checkout workflows.
  • Comfort using approved personal payment methods for required purchases and following reimbursement procedures.
  • Eligible task expenses may be reimbursed under approved procedures.

How it works

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.

About AI training work

AI training is the human work behind systems that learn from examples, including reviewing AI outputs and rating how well they complete tasks. People with strong digital skills and careful judgment help make these systems more accurate and useful.

Where you can work

This role is 100% remote, for applicants located in United States.

From OpenTrain AI's job posting, checked 16 Nov 2026.

About OpenTrain AI

A unified board of AI-training jobs with real per-role pay.

How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.

When it pays: When the employer approves each funded milestone. How often others pay

Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works

Similar open roles

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new OpenTrain AI roles by email

We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.