Skip to content

AI Evaluation

AI Trainer (Part-time)

Kastle logoKastle$30/hrRemote, open worldwideFull-timePosted 7mo ago

About the role

About Kastle

Kastle is building the AI operating system for consumer lending. We partner with some of America’s largest mortgage lenders to transform their contact centers and compliance operations with AI voice agents.

Backed byY Combinator, Commerce Ventures, and executives from Snapdocs, Google, and WePay, we’re redefining how millions of borrowers interact with financial institutions.

This is a rare chance to join at the ground floor of a company already plugged into large-scale customers and real production use cases.

Role Overview

We are looking for a part-time AI Trainer with experience operating phones in the mortgage industry. You will help improve our AI system by providing feedback on conversations, annotating data, and testing for quality. If you have worked as a customer service or collections agent for a mortgage servicer, this role is a great fit to use your knowledge to train AI in real-world scenarios.

Responsibilities

  • Annotate and label data from mortgage-related conversations.
  • Give feedback on AI responses to make them more accurate and helpful.
  • Train the AI system to handle mortgage servicing phone calls better.
  • Test the AI for issues, including response quality, customer experience, explanation quality, and realism.
  • Work ~10 hours per week on flexible schedules.

Requirements

  • 5+ years a customer service agent for a mortgage servicing company.
  • Knowledge of the mortgage industry, including escrow, payment questions, loss mitigation calls, QRPC requirements, servicing transfer questions, and customer conversations.
  • Strong attention to detail and communication skills.
  • Reliable internet and computer for remote work.

Preferred Qualifications

  • 3+ years as a Mortgage Customer Service Supervisor.
  • Familiarity with giving feedback to customer service agents.

Benefits

  • Flexible part-time hours.
  • Opportunity to shape cutting-edge AI technology.
  • Work from home.

Where you can work

This role is 100% remote: you can work from anywhere in the world.

From Kastle's job posting, checked 29 Oct 2026.

The application

Just your details and CV.

Have readyCV

From Kastle's apply page, checked 29 Oct 2026.

About Kastle

Mortgage servicing AI company paying experienced servicing agents $30 an hour, part-time and remote, to annotate and test its voice agents.

How it pays: Hourly pay; no payment schedule is stated.

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you. A role at a platform that pays us a referral fee weighs more in this order.

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new Kastle roles by email

We check the Kastle job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.