Overview
ABOUT THE ROLE
Full job description
ABOUT THE ROLE Join an early-stage AI infrastructure team focused on reinforcement learning environments and model evaluation. In this role, you will build quality control systems for training data, helping scale reliable data creation and improve agent performance evaluation. WHAT YOU'LL DO
- Automate quality control for training data created within reinforcement learning environments.
- Define and enforce data quality standards using human judgment and domain understanding.
- Design experiments and metrics to assess agent outputs.
- Work with data vendors to investigate quality issues, identify agent failure modes, and improve data generation processes.
- Turn quality findings into auditing systems, including sampling strategies and rule-based or model-assisted validation pipelines.
- Integrate quality improvements into platform infrastructure and vendor tools to reduce anomalies and inconsistencies. WHAT WE'RE LOOKING FOR
- Two to four years of experience in a research engineering or similar role focused on quality control automation.
- A degree in a technical field and proficiency with Python, Docker, and Linux.
- Experience building scalable data validation pipelines and automated QA/QC systems end to end, including in unstructured problem spaces.
- Background in benchmarks and evaluations for reinforcement learning data, including realistic task design, reliable rubrics, and useful training trajectories.
- Experience defining training data quality standards and building systems guided by human judgment rather than heavy reliance on language models.
- Knowledge of statistics and experience designing metrics, experiments, and quality assurance processes.
- Clear communication skills, curiosity, independence, and comfort working in a fast-paced startup environment across time zones. COMPENSATION & BENEFITS Salary: $100,000 to $170,000 USD annually. Visa sponsorship is available. LOCATION On-site in Singapore, Singapore.
Tips for this job
Practical JobOpportunity guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
JobOpportunity.info helps you discover and organize source listings. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Apply through JobOpportunity →