AI Trainer (Contractor), Voice and Speech Evaluation - USA
About the role
About Inworld
Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads.
Hundreds of millions of users interact with Inworld powered apps every day and we serve over 10 trillion LLM tokens per month. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more. Our work spans model research, realtime inference, large-scale serving infrastructure, and the APIs developers use to bring these capabilities into production.
We’ve raised more than $125M from Lightspeed Venture Partners, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta, Stanford, and others. Our technology has powered experiences from companies including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella, and Bible Chat. Inworld has also been recognized by CB Insights as one of the 100 most promising AI companies globally and named one of LinkedIn’s Top 10 Startups in the USA.
What you'll do
- Listen to paired or grouped speech samples and judge which sounds more natural, expressive, or faithful to instructions
- Score voices against rubrics for naturalness, clarity, emotion, pacing, and delivery style
- Label voice attributes such as perceived gender, age, accent or dialect, and tone, and flag mismatches with existing metadata
- Judge how closely cloned voices match their source speaker
- Review batches of new voices for audio quality and suitability before public release
- Test new speech features in pre-release environments and report bugs, edge cases, and usability issues
- Write clear, structured findings that engineers can act on
- For multilingual roles: evaluate pronunciation, dialect accuracy, and naturalness in your native language
What we're looking for
- A trained ear. Background in audio production, broadcast, voice acting, music, linguistics, phonetics, or similar
- Ability to hear and describe subtle differences in prosody, timing, pronunciation, and audio quality
- Consistent, careful judgment across large batches of similar samples
- Comfort with beta web tools, VPN access, and spreadsheets, and willingness to troubleshoot minor access issues
- Strong written English for reporting findings
- Ability to turn tasks around within a day when needed, including occasional weekend availability
Nice to have
- Native or near-native fluency in Hindi, Tamil, Telugu, Bengali, Marathi, Brazilian Portuguese, or a regional Spanish dialect
- Experience with TTS, voice AI, dubbing, or localization QA
- Familiarity with A/B evaluation or annotation work
Location: Remote within the United States.
Compensation: $20-$55 per hour. Rate depends on region and language specialty.
Inworld Jobs Privacy
Where you can work
This role is 100% remote, for applicants located in United States.
From Inworld AI's job posting, checked 29 Oct 2026.
The application
Just your details and CV.
From Inworld AI's apply page, checked 29 Oct 2026.
About Inworld AI
Realtime speech AI lab paying US contractors with trained ears (audio production, voice acting, broadcast, linguistics) $20 to $55 an hour to rate and test its voices before release.
How it pays: Hourly contract pay; no payment schedule is stated.
Similar open roles
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Healthcare Quality Specialist Expert (opens the job details)
AfterQuery · Domain Experts · Remote· 2mo agoDetails
$100/hr
AI Image & Video Judge: Spot the Flaws, Pick the Winner (opens the job details)
Outlier (Scale AI) · Data Annotation · Remote· todayDetails
up to $18/hr
Filipino (Tagalog) Language Expert (opens the job details)
SuperAnnotate (SME) · Multilingual · Remote· 4mo agoDetails
up to $20/hr

Food Delivery AI Response Evaluator (opens the job details)
micro1 · AI Evaluation · Remote· 2d agoDetails
$10–$30/hr
Native in a language companies are short of?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new Inworld AI roles by email
We check the Inworld AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.