Skip to content

AI Evaluation

Federal IT Specialist (AI Evaluation)

The middle of its range, $92.50/hr, is above the $70/hr median of the AI Evaluation & Rating (RLHF) roles open now, whose typical pay runs $35–$130/hr. How that pay moves week by week is in our research on AI Evaluation & Rating (RLHF) work.

Half of all AI Evaluation & Rating (RLHF) roles come down within 18.5 days of being listed, and 33.6% are still up after four weeks. This one was posted 12 days ago.

About the role

The work

You will review AI-generated materials used in federal IT operations and judge whether they are accurate, complete, secure, and aligned with federal requirements. You will also assess how well AI systems handle realistic IT and security scenarios.

Your feedback will help improve AI systems used for federal IT work. The role combines documentation review with technical evaluation of systems, incidents, configurations, and security controls.

  • Review authorization to operate packages, IT investment business cases, incident reports, privacy impact assessments, technical guidance, and related federal IT documents.
  • Diagnose complex hardware, software, network, and application incidents represented in AI-generated scenarios.
  • Evaluate technical documentation, system configurations, and security controls for accuracy and alignment with federal requirements.
  • Provide clear feedback to improve AI model performance in federal IT use cases.
  • Support incident-response simulations and assess whether AI systems detect and address security incidents appropriately.

What it pays and takes

This is a remote, part-time contractor role.

  • Pay: $80 to $105 per hour.
  • Work arrangement: Remote, part-time contract work.
  • Language: Fluency in English.
  • Location: Open to candidates in the United Arab Emirates, Argentina, Austria, Bangladesh, Belgium, Bahrain, Brazil, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, France, the United Kingdom, Ghana, Greece, Indonesia, India, Italy, Jordan, Japan, Kenya, Kyrgyzstan, Kuwait, Kazakhstan, Lebanon, Sri Lanka, Morocco, Mexico, Malaysia, Nigeria, the Netherlands, Oman, Peru, the Philippines, Pakistan, the Palestinian territories, Portugal, Qatar, Saudi Arabia, Singapore, Thailand, Tunisia, Taiwan, the United States, Uzbekistan, Vietnam, and South Africa.
  • Experience: At least five years of federal IT experience in GS-2210 or an equivalent role.
  • Technical background: Hands-on experience with hardware repair, network administration, incident response, and varied IT environments.
  • Security and documentation: Experience implementing or assessing information security controls under federal frameworks such as FISMA and NIST.
  • Federal materials: Experience preparing or reviewing authorization to operate packages, privacy impact assessments, incident reports, or IT investment business cases.
  • Judgment: Strong judgment about data integrity, security, privacy, and information assurance.
  • Helpful experience: Federal information technology management, systems administration, cybersecurity, software development, telecommunications, computer engineering, or computer science.

How it works

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 6 screening questions.

About AI training work

AI training is the human work behind systems that learn from examples, including reviewing documents, rating model responses, and testing whether AI follows technical requirements. People with specialized experience are needed to judge accuracy and risk in fields such as federal IT, security, and incident response. OpenTrain helps people find these roles, build a profile, and apply in one place.

Creating an OpenTrain account is free, and OpenTrain is not the employer or payer for this role.

Where you can work

This role is 100% remote, for applicants located in these 48 countries: United Arab Emirates, Argentina, Austria, Bangladesh, Belgium, Bahrain, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, France, United Kingdom, Ghana, Greece, Indonesia, India, Italy, Jordan, Japan, Kenya, Kuwait, Kazakhstan, Sri Lanka, Morocco, Mexico, Malaysia, Nigeria, Netherlands, Oman, Peru, Philippines, Pakistan, Portugal, Qatar, Saudi Arabia, Singapore, Thailand, Tunisia, Taiwan, United States, Uzbekistan, Vietnam and South Africa.

From OpenTrain AI's job posting, checked 16 Nov 2026.

About OpenTrain AI

A unified board of AI-training jobs with real per-role pay.

How it pays: Stripe payouts to your bank, in the 120 countries its payout docs list.

When it pays: When the employer approves each funded milestone. How often others pay

Interview: on some roles or projects (AI interview (switched on per job by the employer)). How the OpenTrain AI AI interview works

Similar open roles

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new OpenTrain AI roles by email

We check the OpenTrain AI job board every hour and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.