Job
Source description available
Source: Clera (ashby) · A retrieval date records when our system last obtained the source record. It does not guarantee the vacancy is still open or that every detail has been independently checked.
Description from the source
The source description is formatted below for discovery. The provider owns the original wording and may change its requirements or close applications.
EmploymentFull-time
Overview
ABOUT THE ROLE
Full job description
ABOUT THE ROLE Own complex, time-sensitive data and evaluation programs for AI research teams and internal partners. This role brings together technical program management, data operations, and vendor coordination to turn evolving requirements into reliable programs that improve AI and agent evaluation. WHAT YOU'LL DO
- Manage data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
- Translate ambiguous technical requests into specifications with clear milestones, owners, dependencies, and acceptance criteria.
- Improve data quality processes through quantitative metrics and qualitative review, including analysis of task coverage, difficulty, and reward distributions.
- Manage external vendors across the delivery lifecycle and scale delivery pipelines.
- Improve production workflows, documentation, automation, and cross-functional handoffs.
- Partner with research, platform, and marketplace teams to turn program learnings into product improvements. WHAT WE'RE LOOKING FOR
- At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a related cross-functional field.
- Experience turning ambiguous technical requirements into executable plans and maintaining data quality through metrics and direct inspection.
- Strong judgment assessing dataset quality, moving between aggregate measures and individual examples.
- Experience managing vendors, improving delivery pipelines, and documenting or automating workflows and handoffs.
- Background supporting AI research teams, technical enterprise customers, or other teams with urgent, changing requirements.
- Familiarity with RLHF, reinforcement-learning environments, agent evaluation, human-in-the-loop data pipelines, annotation, or expert data collection is valuable.
- Comfort working independently in a fast-paced startup environment. COMPENSATION & BENEFITS Base salary is $130,000 to $225,000 USD annually. Visa sponsorship and relocation support are available for strong full-time candidates. LOCATION On-site in San Francisco, California. The role is also open to remote candidates who can maintain 70% to 80% time zone overlap with San Francisco or Singapore.
Tips for this job
Practical JobOpportunity guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Original authoritative source
JobOpportunity.info helps you discover and organize source listings. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Apply through JobOpportunity →