Gmail & Google Calendar AI Assistant Evaluator
The middle of its range, $22.50/hr, is below the $60/hr median of the Agentic Tasks & RL Environments roles open now, whose typical pay runs $50–$120/hr. How that pay moves week by week is in our research on Agentic Tasks & RL Environments work.
Half of all Agentic Tasks & RL Environments roles come down within 9.3 days of being listed, and 34.1% are still up after four weeks. This one was posted 50 days ago.
About the role
The work
You will test AI assistants using everyday email, calendar, booking, scheduling, and coordination tasks. You will check whether each assistant completes the task accurately and fully, then record your findings.
The work includes giving clear instructions, grading and ranking responses, adding annotations, and submitting structured evaluation data. You may also identify unusual cases, discuss unclear examples with other contributors and trainers, and use feedback during quality reviews.
- Complete repeatable tasks involving Gmail messages, email threads, calendar invitations, bookings, scheduling, and multi-person coordination.
- Check AI-generated work for accuracy, completeness, and adherence to evaluation guidelines.
- Grade, rank, and annotate assistant responses using structured AI training tools.
- Record findings and submit evaluation data.
- Identify edge cases and resolve unclear examples with contributors and trainers.
What it pays and takes
This is a remote contractor role with part-time employment. Candidates must be based in the United States and fluent in English.
- Pay: $15 to $30 per hour.
- Work type: Contractor and part-time.
- Location: Open to candidates in the United States.
- Language: Fluent in English.
- Experience: Daily hands-on experience with Gmail and Google Calendar, including sending messages, accepting invitations, scheduling, and changing plans.
- Coordination: Experience working with others by email or text and booking restaurants, appointments, travel, deliveries, or similar services.
- Devices and accounts: An iPhone with iMessage and an active Facebook or Instagram account.
- Skills: Clear written communication, careful attention to detail, time management, self-organization, and comfort instructing AI tools and checking their work.
- Helpful experience: AI evaluation, data labeling, user testing, prompt writing, or reviewing model outputs for accuracy, helpfulness, and safety.
How it works
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.
About AI training work
AI training is the human work behind AI systems. People test and review model outputs, prepare examples, and provide feedback so assistants can behave more accurately and usefully. OpenTrain helps people find these projects, build a profile, and apply in minutes.
Where you can work
This role is 100% remote, for applicants located in United States.
From OpenTrain AI's job posting, checked 16 Nov 2026.
About OpenTrain AI
A unified board of AI-training jobs with real per-role pay.
How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.
When it pays: When the employer approves each funded milestone. How often others pay
Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works
Similar open roles

Open Source GitHub Maintainer Code Review (opens the job details)
OpenTrain AI · Coding · Remote· 1mo agoDetails
$120–$200/hr
CBRN Specialist (AI Safety Review) (opens the job details)
OpenTrain AI · Red-Teaming · Remote· 2mo agoDetails
up to $60–$100/hr

Language Expert (Korean Audio Transcription) (opens the job details)
OpenTrain AI · Transcription & Audio · Remote· 1mo agoDetails
$20–$36/hr
Full-Stack Engineer (opens the job details)
OpenTrain AI · Coding · Remote· 2mo agoDetails
$50–$100/hr
An experienced engineer?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new OpenTrain AI roles by email
We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.