Remote Domain Expert, AI Evaluation (Registered Nurse / Nurse Practitioner)

Job Overview

  • Clinical License RN, APRN
  • State(s) Nationwide

Job Description

Job Title: Domain Expert, AI Evaluation (Registered Nurse / Nurse Practitioner)

Location: Remote (US)

Employment Type: Full-time, Short-term Fixed Contract

Contract Duration: 1 to 6 Months (Project-Based)

Compensation: Task-Based (Competitive payment per approved task)

Department: Research Operations

About the Role

We are looking for experienced Registered Nurses and Nurse Practitioners to contribute to AI evaluation projects by creating high-quality evaluation data for advanced AI systems.

This is a specialist role for nursing professionals, not a generalist research position. As a Domain Expert, you will use your clinical expertise to develop realistic healthcare scenarios, evaluate AI reasoning, and provide accurate, evidence-based expert solutions.

Key Responsibilities

  1. Design original, domain-specific nursing and healthcare tasks based on real-world practice.
  2. Produce the correct expert answer (“golden answer”) for each task with clear clinical reasoning.
  3. Develop challenging evaluation scenarios that expose limitations in advanced AI models.
  4. Meet defined quality, accuracy, and formatting standards while completing each task independently.
  5. Incorporate reviewer feedback and maintain consistent quality across submissions.

Required Qualifications

Education & Experience

  • Registered Nurse (RN) or Nurse Practitioner (NP).
  • Minimum 2 years of clinical or professional experience.

Required Skills

  • Strong nursing expertise and current clinical knowledge.
  • Excellent written English with the ability to communicate complex reasoning clearly.
  • Strong analytical and critical thinking abilities.
  • High attention to detail and quality.
  • Ability to work independently in a structured environment.

Requirements

  • Full-time availability during the engagement.
  • Own laptop with a modern browser.
  • Reliable high-speed internet connection.

Compensation

  • Task-Based Compensation
  • Competitive payment for each approved task.
  • Earnings depend on the quality and number of completed tasks.

Onboarding & Work Integrity

  1. Successful completion of the project onboarding assessment is required before beginning paid work.
  2. All deliverables must be original, human-authored work. The use of AI writing or editing tools of any kind (including grammar assistants) is strictly prohibited.
  3. Employment is subject to signing a Non-Disclosure Agreement (NDA).
Case Management, Managed Care

Thanks for visiting!

The Remote Nurse is a large online community and Job Board specializing in Remote Clinical Jobs for Nurses, Nurse Practitioners, and Physician Assistants.

Follow us!