Plumber Expert

Licensed plumbers to build the diagnosis and code compliance scenarios frontier AI labs use to test model judgment on real trade work. Remote, async, paid weekly. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring licensed plumbers as contractors to author and grade the diagnosis and code compliance scenarios those evaluations run on. This is knowledge work built on your trade, done entirely from home. What you'll actually do

Author realistic plumbing scenarios from symptom through diagnosis and repair, the kind you actually run on a service call. Write reference answers with the diagnostic and code reasoning behind each step, why that venting, why that slope, which code section. Grade model output for code compliance, safety, and workmanship. Flag advice that reads plausible but would flood a basement or contaminate a water line, the misses only a working plumber would catch.

Who this is for

Journeyman and master plumbers with an active US license and at least two years of field work beyond apprenticeship. Residential service, commercial, and new construction plumbers, all specialties welcome. Tradespeople who can explain the why behind the fix, not just the fix. People comfortable writing clearly, this work is typed, not soldered.

Contract and pay

$50 to $90/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start. Fully remote, fully async. No fixed hours, it fits around jobs. Minimum 10 hours per week, no maximum. Scale up or down week to week. No screen recording, no keystroke monitoring, no idle timers. Independent contractor. Ongoing project work rather than single task batches.

How our hiring process works

Apply at /apply/plumber-expert. About five minutes. Resume plus a few structured questions. Resume review. Every application gets read against a published rubric and gets a decision. Written assessment. You may be asked to take a written assessment for further placement. Onboarding. Sign the contractor agreement, connect Stripe, and get platform access. Project match. You're matched to live work in your specialty, usually within a week of onboarding.

About AfterQuery

AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates.

Responsibilities

• Author realistic plumbing scenarios from symptom through diagnosis and repair
• Write reference answers with the diagnostic and code reasoning behind each step
• Grade model output for code compliance, safety, and workmanship
• Flag advice that reads plausible but would flood a basement or poison a water line

Required qualifications

• Journeyman or master plumber license in a US state or jurisdiction
• 2+ years of field experience beyond apprenticeship
• Working command of plumbing codes such as UPC or IPC
• Clear written English for documenting diagnostic reasoning
• Able to commit at least 10 hours per week

Preferred qualifications

• Master plumber or plumbing contractor license
• Commercial, medical gas, or backflow certification depth
• Estimating, inspection, or apprentice training experience

Why apply

• Paid for your trade knowledge, no tools, no travel, no job site
• Set your own hours and scale up or down week to week, it fits around jobs
• Weekly pay via Stripe at a rate set from your experience
• Your judgment shapes how the next generation of AI handles the trades

Where you can work

This role is 100% remote, for applicants located in United States.