Overview
Position Overview
Full job description
Position Overview We are seeking qualified medical professionals to serve as Evaluator Subject Matter Experts for an AI-powered learning platform designed to support medical students during their pre-clinical years and USMLE STEP 1/COMLEX preparation. Primary Responsibilities Evaluate and assess AI-generated content responses covering basic science topics and medical school curriculum Apply established evaluation metrics to rate content for accuracy, completeness, relevance, and educational utility Provide expert feedback to ensure content meets the learning needs of first and second-year medical students Complete asynchronous evaluations within specified deadlines (5 days to 2 weeks, depending on workload) Participate in quarterly evaluation cycles with potential for ad-hoc assessments Required Qualifications Candidates must meet ONE of the following criteria: Current PGY-1 resident in a US medical residency program (MD or DO degree), OR Fourth-year medical student from an ACGME-accredited medical school who has successfully passed USMLE Steps 1 & 2 Preferred Qualifications Prior experience in medical education content review Strong understanding of medical education pedagogy and learning outcomes Time Commitment 5-15 hours per week during active evaluation periods Minimum of 4 evaluation cycles per year Project Details Duration: November 2025 – December 2026 (with possibility of extension) Start Date: First evaluation round begins November 5, 2025 Compensation: $60 USD per hour Work Arrangement: Remote (US time zones) Contract Structure: Employment through third-party contracting agency
Tips for this job
Practical Job and Scholarship guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Verification notes
laptop-ats-crawler v2
Job and Scholarship is the discovery and verification layer. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Osmosis (greenhouse) ↗Browse current Job and Scholarship listings from Osmosis (greenhouse) →