Competitive Data Scientist (Kaggle) - AI Training & Evaluation
The middle of its range, $90/hr, is above the $70/hr median of the AI Evaluation & Rating (RLHF) roles open now, whose typical pay runs $35–$130/hr. How that pay moves week by week is in our research on AI Evaluation & Rating (RLHF) work.
Half of all AI Evaluation & Rating (RLHF) roles come down within 19 days of being listed, and 34.8% are still up after four weeks. This one was posted today.
About the role
This role is for one of our clients
Compensation: $60–$120 per hour Location: Global – Fully Remote Employment Type: Independent Contractor Work Commitment: Approximately 15 hours per week Schedule: Flexible – Choose your preferred working days and hours, including weekends.
About the Role
We are looking for highly skilled Data Scientists, Machine Learning Practitioners, and Applied Mathematics Experts with a strong track record in competitive data science, particularly on Kaggle or similar competition platforms.
In this role, you will leverage your competition experience, mathematical reasoning, and programming expertise to develop challenging technical tasks for AI training and evaluation. The focus is on creating problems that require genuine analytical thinking and robust implementation rather than solutions that simply appear plausible.
Each task should include a reproducible execution environment, a verified reference solution, and reliable evaluation mechanisms to determine whether a solution is technically correct and complete.
The ideal candidate combines strong competitive programming and data science skills with the ability to develop, test, debug, and independently validate complex solutions.
Key Responsibilities
- Build reproducible computational environments, prepare relevant datasets and dependencies, and implement reliable reference solutions.
- Design challenging data science and machine learning tasks that require strong analytical reasoning and practical implementation skills.
- Develop test cases, evaluation criteria, and verification mechanisms that distinguish correct solutions from incomplete, inaccurate, or flawed approaches.
- Execute coding agents against assigned tasks, analyse their outputs, investigate failures, and refine tasks based on observed performance.
- Identify implementation errors, incorrect assumptions, data leakage, methodological weaknesses, and other issues that may affect solution accuracy.
- Validate solutions through independent testing, computational experiments, and reproducible workflows.
- Document task requirements, solution methodologies, technical reasoning, and verification procedures clearly.
- Ensure that all tasks and reference solutions meet high standards of correctness, reliability, and reproducibility.
Required Skills and Qualifications
- Expert rank or higher on Kaggle or a comparable competitive data science platform.
- Demonstrated experience participating in competitive data science, machine learning, or applied mathematics challenges.
- Strong understanding of data science methodologies, machine learning techniques, statistical analysis, and mathematical problem-solving.
- Ability to explain the reasoning behind selected approaches, algorithms, and implementation decisions.
- Practical programming proficiency sufficient to independently develop, implement, test, and verify solutions.
- Experience building reproducible workflows and evaluating technical solutions against defined criteria.
- Strong analytical thinking, debugging skills, and attention to detail.
Relevant Competition Platforms
Experience with one or more of the following platforms is highly relevant:
- Kaggle
- DrivenData
- Zindi
- AIcrowd
- Numerai
- DataSource.ai
- CodaLab / Codabench
Preferred Skills and Additional Advantages
- Strong hands-on coding experience, particularly in Python.
- Proficiency in testing, debugging, and troubleshooting complex implementations.
- Ability to navigate unfamiliar codebases, understand existing workflows, and implement solutions efficiently.
- Experience with Python-based data science and machine learning libraries.
- Familiarity with automated evaluation, benchmarking, and reproducibility practices.
- Experience working with coding agents or AI-assisted development tools.
Engagement Details
- Compensation: $60–$120 per hour.
- Location: Global – Fully Remote.
- Employment Type: Independent Contractor.
- Work Commitment: Approximately 15 hours per week.
- Schedule: Flexible working hours, with the option to work on weekends.
Where you can work
This role is 100% remote, for applicants located in India and United States.
From Weekday's job posting, checked 18 Nov 2026.
The application
Just your details and CV.
From Weekday's apply page, checked 18 Nov 2026.
About Weekday
A recruiting company that staffs AI training companies' expert projects, most of them open in the US and paid by the approved hour or task.
How it pays: 14 of its 90 AI-training postings say when they pay, all weekly (12 of those posted on 12 Nov 2026 through Stripe or Wise); the rest do not say. Its 2025 postings for an AI lab said independent contractors were paid weekly (daily on two) through Stripe Connect (its Workable board, read 15 Nov 2026).
When it pays: Most postings name no schedule. How often others pay
Interview: on some roles or projects (Per-posting screening (AI interview, timed tests or portfolio review) and a manager's review). Platforms with no interview
Similar open roles
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Prompt & Response Evaluator (opens the job details)
micro1 · AI Evaluation · Remote· 5d agoDetails
$40–$70/hr
Document Annotation Specialist (PDF) (opens the job details)
SuperAnnotate (SME) · Data Annotation · Remote· 1w agoDetails
up to $10/hr
Full-Stack Software Engineer - Testing & Evaluation (opens the job details)
AfterQuery · AI Evaluation · Remote· 11mo agoDetails
$75/hr
Postal Clerk AI Response Evaluator (opens the job details)
OpenTrain AI · Domain Experts · Remote· 1mo agoDetails
$30–$45/hr
Want companies to ask for you?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new Weekday roles by email
We check the Weekday job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.