Job
Source description available
Source: Clera (ashby) · A retrieval date records when our system last obtained the source record. It does not guarantee the vacancy is still open or that every detail has been independently checked.
Description from the source
The source description is formatted below for discovery. The provider owns the original wording and may change its requirements or close applications.
EmploymentFull-time
Overview
ABOUT THE ROLE
Full job description
ABOUT THE ROLE Lead complex data and evaluation programs for AI research teams and internal partners. You will turn evolving technical needs into reliable delivery processes and help ensure data and evaluations meaningfully improve AI models and agents. WHAT YOU'LL DO
- Own programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
- Translate ambiguous requests into clear specifications with milestones, owners, dependencies, and acceptance criteria.
- Assess and improve data quality using quantitative metrics and qualitative review, including task coverage, difficulty, and reward distributions.
- Manage external vendors and improve delivery pipelines as programs scale.
- Improve workflows, documentation, automation, and cross-functional handoffs for data production and evaluation.
- Partner with research, platform, and marketplace teams to turn feedback into product improvements. WHAT WE'RE LOOKING FOR
- At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a related cross-functional area.
- Experience as a Technical Program Manager or Strategic Program Lead at a startup.
- Ability to structure ambiguous technical requirements and maintain momentum as needs change.
- Experience improving data quality processes and evaluating datasets through both aggregate metrics and individual examples.
- Experience managing vendors, scaling delivery pipelines, and supporting AI research teams or technical enterprise customers with changing requirements.
- Familiarity with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, or expert data collection is valuable.
- Strong written and verbal communication skills, sound judgment, and the ability to work independently in a fast-paced environment. COMPENSATION & BENEFITS Salary range: $130,000 to $225,000 USD annually. Visa sponsorship is available for full-time candidates. LOCATION On-site in San Francisco, California, United States.
Tips for this job
Practical JobOpportunity guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Original authoritative source
JobOpportunity.info helps you discover and organize source listings. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Apply through JobOpportunity →