Python ML-Focused Team Lead
Half of all Coding & Software Evaluation roles come down within 18 days of being listed, and 45.4% are still up after four weeks. This one was posted 131 days ago.
About the role
The work
- Review AI-generated Python code, machine learning pipelines, preprocessing steps, model training workflows, evaluation logic, and explanations for correctness and reproducibility.
- Check work for data leakage, statistical validity, debugging accuracy, formatting, readability, maintainability, and instruction-following.
- Give precise written feedback to contributors and escalate recurring or critical quality issues.
- Answer contributor questions about Python syntax, package usage, data leakage, model validation, metrics, reproducibility, notebooks, and rubric interpretation.
- Update guidance, trackers, FAQs, examples, honeypots, and onboarding materials.
- Support onboarding and training calls for Python machine learning contributors.
- Help maintain scalable quality assurance processes for remote technical teams.
- Support contributor communication, documentation, calibration tasks, and process improvements across technical review workflows.
What it pays and takes
This is an intermediate, part-time contractor role for someone who can lead or support careful technical reviews of Python and machine learning work.
- Pay: up to $120 per hour.
- Time: 20+ hours per week.
- Work setting: remote and open to candidates in the United States.
- Strong Python fundamentals, including data structures, functions, classes, iterators, comprehensions, exception handling, virtual environments, package management, testing, and debugging.
- Strong machine learning knowledge across supervised and unsupervised learning, feature engineering, train/test splits, cross-validation, model selection, data leakage, regression, classification, clustering, metrics, bias and variance, regularization, and reproducibility.
- Ability to assess machine learning content against detailed rubrics and identify flawed methodology, incorrect metrics, hallucinated APIs, misleading conclusions, and incomplete explanations.
- Strong English communication skills for clear technical feedback and team coordination.
- Experience with AI training, data annotation, large language model evaluation, code quality assurance, machine learning quality assurance, or rubric-based technical review is a strong plus.
- Experience leading or supporting remote teams of trainers, reviewers, engineers, data scientists, or machine learning researchers is preferred.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training is the human work behind systems that generate, understand, and evaluate code and other content. People review examples, rate model outputs, and give clear feedback so AI systems become more accurate and useful; experienced technical reviewers are needed for specialized work.
Where you can work
This role is 100% remote, for applicants located in United States.
From OpenTrain AI's job posting, checked 17 Nov 2026.
About OpenTrain AI
A unified board of AI-training jobs with real per-role pay.
How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.
When it pays: When the employer approves each funded milestone. How often others pay
Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works
Similar open roles
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Prompt & Response Evaluator (opens the job details)
micro1 · AI Evaluation · Remote· 4d agoDetails
$40–$70/hr
Document Annotation Specialist (PDF) (opens the job details)
SuperAnnotate (SME) · Data Annotation · Remote· 6d agoDetails
up to $10/hr
Swift Engineer (iOS Code Review) (opens the job details)
OpenTrain AI · Coding · Remote· 4mo agoDetails
up to $55/hr
Full-Stack Software Engineer - Testing & Evaluation (opens the job details)
AfterQuery · AI Evaluation · Remote· 11mo agoDetails
$75/hr
Generalist AI Trainer (opens the job details)
RemoExperts · AI Evaluation · Remote· 1y+ agoDetails
$30–$65/hr
An experienced engineer?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new OpenTrain AI roles by email
We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.