Remote Domain Expert, AI Evaluation (Registered Nurse / Nurse Practitioner)
Job Overview
- Clinical License RN, APRN
- State(s) Nationwide
Job Description
Job Title: Domain Expert, AI Evaluation (Registered Nurse / Nurse Practitioner)
Location: Remote (US)
Employment Type: Full-time, Short-term Fixed Contract
Contract Duration: 1 to 6 Months (Project-Based)
Compensation: Task-Based (Competitive payment per approved task)
Department: Research Operations
About the Role
We are looking for experienced Registered Nurses and Nurse Practitioners to contribute to AI evaluation projects by creating high-quality evaluation data for advanced AI systems.
This is a specialist role for nursing professionals, not a generalist research position. As a Domain Expert, you will use your clinical expertise to develop realistic healthcare scenarios, evaluate AI reasoning, and provide accurate, evidence-based expert solutions.
Key Responsibilities
- Design original, domain-specific nursing and healthcare tasks based on real-world practice.
- Produce the correct expert answer (“golden answer”) for each task with clear clinical reasoning.
- Develop challenging evaluation scenarios that expose limitations in advanced AI models.
- Meet defined quality, accuracy, and formatting standards while completing each task independently.
- Incorporate reviewer feedback and maintain consistent quality across submissions.
Required Qualifications
Education & Experience
- Registered Nurse (RN) or Nurse Practitioner (NP).
- Minimum 2 years of clinical or professional experience.
Required Skills
- Strong nursing expertise and current clinical knowledge.
- Excellent written English with the ability to communicate complex reasoning clearly.
- Strong analytical and critical thinking abilities.
- High attention to detail and quality.
- Ability to work independently in a structured environment.
Requirements
- Full-time availability during the engagement.
- Own laptop with a modern browser.
- Reliable high-speed internet connection.
Compensation
- Task-Based Compensation
- Competitive payment for each approved task.
- Earnings depend on the quality and number of completed tasks.
Onboarding & Work Integrity
- Successful completion of the project onboarding assessment is required before beginning paid work.
- All deliverables must be original, human-authored work. The use of AI writing or editing tools of any kind (including grammar assistants) is strictly prohibited.
- Employment is subject to signing a Non-Disclosure Agreement (NDA).



