Skip to content

AI Evaluation

Japanese Team Lead

SuperAnnotate (SME) logoSuperAnnotate (SME)up to $55/hrRemote in JapanContractPosted todayTalent pool: no project yet

Half of all AI Evaluation & Rating (RLHF) roles come down within 18 days of being listed, and 32.9% are still up after four weeks. This one was posted today.

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.

About the role

In this hourly, remote contractor role, you will work as a Japanese Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across Japanese AI training projects. You will review AI-generated Japanese content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards.

You will assess work for accuracy, fluency, grammar, spelling, tone, cultural appropriateness, meaning preservation, instruction-following, formatting, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently.

This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your Japanese quality leadership will directly help improve the world’s premier AI models by ensuring that Japanese training data is natural, accurate, culturally appropriate, well-documented, and aligned with client expectations.

Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter.

Important

There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Responsibilities

  • Spot-check Japanese items, identify quality issues, provide feedback through DMs, and escalate recurring or critical issues.
  • Update trainers and QAs on Discord about guidelines, project changes, workflow updates, and quality expectations.
  • Respond to questions around Japanese grammar, keigo, register, kana/kanji usage, translation fidelity, cultural context, terminology, and edge cases.
  • DM inactive contributors, encourage activation, track follow-ups, and flag availability issues.
  • Create and maintain Japanese documentation, style guides, trackers, FAQs, quality notes, examples, honeypots, and onboarding materials.
  • Run onboarding/training calls to explain workflows, rubrics, quality standards, and Japanese-specific requirements.
  • Ensure all trainers and QAs apply Japanese language guidelines consistently.
  • Identify recurring quality gaps and build scalable QA processes.

Requirements

  • Bachelor’s or Master’s degree in Japanese, Linguistics, Translation, Communications, Journalism, English, Education, Quality Assurance, or a relevant domain/related field.
  • Native or near-native Japanese proficiency, with strong reading and writing skills.
  • Strong grasp of the English language to follow project guidelines, communicate with teams, and provide clear feedback in English.
  • 3+ years of professional experience in Japanese writing, editing, translation, localization, content QA, AI training, education, annotation, or related language-review workflows.
  • Strong understanding of Japanese grammar, kana/kanji usage, punctuation, keigo, tone, register, honorifics, cultural context, and Japan-specific localization.
  • Ability to evaluate Japanese content against detailed rubrics and identify issues such as mistranslation, literal phrasing, unnatural tone, incorrect keigo, ambiguous references, hallucinated claims, or inconsistent terminology.
  • Experience leading or supporting remote teams of trainers, annotators, reviewers, editors, or QAs is strongly preferred.
  • Comfortable with Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
  • Highly detail-oriented and organized, with the ability to maintain style guides, FAQs, trackers, onboarding materials, honeypots, and documentation.
  • Experience with AI training, data annotation, LLM evaluation, prompt/response evaluation, or rubric-based LLM QA is a strong plus.

Skills

  • Japanese Quality Assurance
  • LLM Evaluation
  • Translation Quality Review
  • Keigo
  • Style Guides
  • Japanese
  • AI Training
  • English
  • Localization QA

Where you can work

This role is 100% remote, for applicants located in Japan.

From SuperAnnotate (SME)'s job posting, checked 13 Nov 2026.

About SuperAnnotate (SME)

Vetted expert network with a data-trainer career ladder.

How it pays: Via Deel (contracts, tax/compliance).

When it pays: Every Friday for the week before, through Deel. How often others pay

Interview: yes, for everyone it takes (SME Careers AI interview, plus a qualification exam and recruiter interview on some roles). How the SuperAnnotate (SME) AI interview works

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new SuperAnnotate (SME) roles by email

We check the SuperAnnotate (SME) job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.