Overview
ABOUT THE ROLE
Full job description
ABOUT THE ROLE This is a Product Engineer role on an AI agent evaluation product, sitting at the intersection of engineering and community. You will ship features that help agent builders build more reliably, while creating in public to close the loop between what the community needs and what gets built. Invisible shipping is shipping that does not matter, so distribution is part of the job. WHAT YOU'LL DO
- Build and ship product features across evals, replay, cohorts, and developer experience, with strong judgment about what is sharp versus theater.
- Create in public on X and GitHub, posting, demoing, and engaging with the AI engineering community to surface signal that feeds back into the product.
- Wear whatever hat the week demands, whether that is feature work, a marketing motion, customer demos, or community engagement.
- Stay close to the target users: AI agent builders, eval practitioners, and developers working with agent frameworks and custom runtimes.
- Close the loop between community feedback and product decisions, ensuring no wall exists between build and distribution. WHAT WE'RE LOOKING FOR
- 3+ years building or shipping production software, with demonstrated experience building or evaluating agents in production environments.
- Strong Python proficiency for production code.
- Hands-on experience with agent frameworks such as LangGraph, or equivalent tools.
- Experience building or working with evaluation systems for LLM or agent outputs.
- Experience with trace data, observability, or debugging agent execution.
- Experience shipping developer tools, SDKs, or APIs with attention to documentation, ergonomics, and demos.
- Open-source contributions with measurable adoption or usage by other developers.
- Active public presence on X, GitHub, or similar platforms demonstrating the ability to communicate and market technical work.
- Comfort operating in early-stage, high-uncertainty environments and wearing multiple roles concurrently.
- Experience with LLM observability platforms or production ML infrastructure is a plus. COMPENSATION & BENEFITS Salary range: $125,000 to $190,000 USD annually. LOCATION This role is fully remote. The primary location is Munich, Bavaria, Germany, though the team also has presence in San Francisco and across Western Europe.
Tips for this job
Practical JobOpportunity guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Verification notes
laptop-ats-crawler v3
JobOpportunity is the discovery and verification layer. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Apply through JobOpportunity →