Job
Full source details
✓ 100% verification score · Source: Clera (ashby) · Always confirm final requirements on the original source.
Complete source information imported
The available role or programme description, requirements, benefits and source facts were imported from the public official endpoint and formatted for reading.
EmploymentFull-time
Overview
ABOUT THE ROLE
Full job description
ABOUT THE ROLE Own complex data and evaluation programs for AI research teams and internal partners. This role brings structure to evolving technical requirements and helps ensure that data and evaluation workflows produce reliable, useful results. WHAT YOU'LL DO
- Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
- Turn ambiguous requests into clear specifications with milestones, owners, dependencies, and acceptance criteria.
- Improve data quality processes through quantitative measures and qualitative review, including assessment of task coverage, difficulty, and reward distributions.
- Manage external vendors across the delivery lifecycle and improve delivery pipelines at scale.
- Improve workflows, documentation, automation, and cross-functional handoffs for data production and evaluation.
- Work with research, platform, and marketplace teams to turn feedback and learnings into product improvements. WHAT WE'RE LOOKING FOR
- At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a related field.
- Experience as a Technical Program Manager or strategic program lead at a startup, with a focus on project delivery rather than product management alone.
- Experience translating ambiguous technical requirements into executable plans and improving complex data quality processes.
- Ability to assess dataset quality using both aggregate metrics and individual examples.
- Experience managing external vendors, scaling delivery pipelines, and supporting AI research teams or technical enterprise customers with evolving needs.
- Familiarity with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, or expert data collection.
- Strong written and verbal communication skills, sound judgment, and comfort working independently in a fast-paced environment. COMPENSATION & BENEFITS Annual salary range: $130,000 to $225,000. Visa sponsorship and relocation support are available for qualified full-time candidates. Benefits include medical, dental, and vision coverage, a retirement plan, paid time off, and commuter benefits. LOCATION On-site in San Francisco, California, United States.
Tips for this job
Practical JobOpportunity guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Verification notes
laptop-ats-crawler v3
Original authoritative source
JobOpportunity is the discovery and verification layer. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Apply through JobOpportunity →