RN Clinical Data Annotation Specialist

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a RN Clinical Data Annotation Specialist based in the United States. We are seeking an experienced Registered Nurse to help improve the accuracy, safety, and reliability of AI-powered clinical solutions. In this fully remote contract role, you will apply your clinical expertise to evaluate AI-generated conversations across primary care, chronic disease management, care coordination, medication adherence, and appointment scheduling. You will assess clinical responses against evidence-based protocols and established practice guidelines, identifying potential safety risks, inaccuracies, and gaps in clinical reasoning. Your evaluations and written feedback will help clinical and product teams refine AI systems to better support patient care. Working independently while collaborating with fellow clinical reviewers, you will contribute to consistent, high-quality evaluation standards. This flexible opportunity is ideal for a clinically experienced nurse interested in the intersection of healthcare, technology, and patient safety.

Evaluate AI-generated clinical interactions: Review recorded and simulated conversations across a range of healthcare scenarios, applying clinical judgment to assess response accuracy, safety, appropriateness, and relevance. Annotate and score performance: Use structured evaluation rubrics to assess AI responses against evidence-based protocols, clinical practice guidelines, and established quality standards. Identify safety risks: Detect potentially harmful recommendations, clinical inaccuracies, inappropriate guidance, edge cases, and weaknesses in clinical reasoning. Provide actionable feedback: Document clear, detailed, and constructive written feedback to help clinical and product teams improve AI agent performance. Support continuous improvement: Contribute clinical insights that strengthen the reliability and quality of AI-driven healthcare interactions. Participate in reviewer calibration: Join periodic calibration sessions with other clinical reviewers to maintain consistent interpretation of evaluation criteria and annotation standards. Maintain quality and productivity: Work independently, pay close attention to detail, and complete reviews within expected turnaround times. Requirements Active nursing license: Hold an active, unrestricted Registered Nurse (RN) license in the United States. A multistate compact license is preferred. Clinical experience: Have at least five years of hands-on clinical experience in areas such as bedside nursing, case management, clinical quality, utilization review, clinical nurse education, or a comparable role. Strong clinical judgment: Demonstrate the ability to assess clinical scenarios, identify potential risks, and apply evidence-based protocols and established practice guidelines. Review and evaluation skills: Be comfortable reviewing written transcripts, assessing clinical content, and applying structured scoring rubrics consistently. Attention to detail: Accurately identify discrepancies, safety concerns, and subtle issues in clinical recommendations and documentation. Written communication: Communicate clinical findings, corrections, and recommendations clearly and concisely in writing. Independent work style: Be organized, self-directed, and able to meet deadlines and expected turnaround times in a remote working environment. Preferred experience: Experience in clinical quality assurance, utilization review, or case review is an advantage. Documentation expertise: Familiarity with chart audits or clinical documentation review is beneficial. Digital health familiarity: Experience with AI-assisted clinical tools or digital health platforms is a plus, but not required. Benefits Remote flexibility: Work fully remotely from the United States. Flexible scheduling: Arrange your schedule flexibly within the expected commitment of 20–40 hours per week. Contract engagement: Work on a 1099 independent contractor basis. Hourly compensation: Receive hourly pay commensurate with your experience. Meaningful clinical impact: Apply your nursing expertise to help improve the safety and quality of AI-driven clinical interactions. Healthcare innovation: Gain exposure to the evolving intersection of clinical practice, artificial intelligence, and digital health. Collaborative environment: Work with clinical reviewers and product teams to help refine technology designed to support healthcare delivery.