Overview
A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases. Responsibilities Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including: Flight bookings and travel support Financial services Telecommunications and technical support Contribute to the development of diverse and representative datasets used to assess conversational audio agents. Evaluate model performance across a standardized set of qualitative and quantitative metrics. Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow. Evaluation Metrics Model performance is assessed using a combination of conversational, technical, and audi
Full job description
Full Job Description
A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases. Responsibilities
-
Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including:
-
Flight bookings and travel support
-
Financial services
-
Telecommunications and technical support
-
Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
-
Evaluate model performance across a standardized set of qualitative and quantitative metrics.
-
Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Evaluation Metrics Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to:
-
Task completion accuracy and efficiency
-
Conversational naturalness (tone, flow, and coherence)
-
Audio comprehension and response quality
-
Instruction adherence and contextual understanding
-
Basic computer programming literacy, including:
-
Understanding of JSON structures
-
Familiarity with functions and methods
-
Ability to reason about structured data and simple logic
-
Technical communication clarity when handling support-style problem-solving
Technical & Equipment Requirements
-
Strong verbal communication skills in a simulated customer support context
-
English proficiency including fluency across all language skills: reading, listening, writing, and speaking.
-
Access to a high-quality microphone to ensure clean, reliable audio input during evaluations
-
Comfort working with structured prompts, evaluation rubrics, and technical guidelines
-
Device capable of running audio recording software and opening large technical documentation
We offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Employment type: Contract Workplace type: Remote Seniority level: Mid‑Senior Level
Tips for this job
Practical Job and Scholarship guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Verification notes
Discovered directly from the employer’s public Greenhouse Job Board API with content=true. The complete public job-ad body was normalized into safe candidate-facing content.
Job and Scholarship is the discovery and verification layer. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Job Boards Eu Greenhouse Io Opportunities ↗Browse current Job and Scholarship listings from Job Boards Eu Greenhouse Io Opportunities →