Overview
About the Role This is a Product Engineer role on an AI agent evaluation product that transforms agent traces into reliable, repeatable evals. You will sit at the intersection of engineering and community, shipping features for agent builders while creating in public on X and GitHub. What you hear from the community feeds directly into what gets built. What You'll Do Build and ship product features covering evals, replay, cohorts, and developer experience, with strong taste for what is genuinely useful versus surface-level. Create in public on X and GitHub, posting, demoing, and engaging with the AI engineering community to surface signal that shapes the product roadmap. Flex across whatever the week demands, whether that is feature work, marketing motion, or customer demos. Stay close to the target audience of AI agent builders, eval practitioners, and developers working with agent fram
Full job description
Full Job Description
About the Role
This is a Product Engineer role on an AI agent evaluation product that transforms agent traces into reliable, repeatable evals. You will sit at the intersection of engineering and community, shipping features for agent builders while creating in public on X and GitHub. What you hear from the community feeds directly into what gets built.
What You'll Do
-
Build and ship product features covering evals, replay, cohorts, and developer experience, with strong taste for what is genuinely useful versus surface-level.
-
Create in public on X and GitHub, posting, demoing, and engaging with the AI engineering community to surface signal that shapes the product roadmap.
-
Flex across whatever the week demands, whether that is feature work, marketing motion, or customer demos.
-
Stay close to the target audience of AI agent builders, eval practitioners, and developers working with agent frameworks and custom runtimes.
-
Close the loop between community feedback and shipped product, treating distribution and engineering as one continuous motion.
What We're Looking For
-
3+ years building or shipping production software, with hands-on experience building or evaluating agents in real systems.
-
Proficiency in Python for production code.
-
Hands-on experience with agent frameworks (such as LangGraph, Claude Code, or equivalent).
-
Experience with evaluation systems for LLM or agent outputs, and with trace data, observability, or agent execution debugging.
-
Experience shipping developer tools, SDKs, or APIs with strong attention to DX, including documentation, ergonomics, and demos.
-
Open-source contributions with measurable adoption or usage by other developers.
-
Active, visible participation on X/Twitter or similar platforms discussing technical work in AI engineering or developer tooling.
-
Comfort operating in an early-stage, high-uncertainty environment where wearing multiple hats is the norm, not the exception.
-
Familiarity with LLM observability platforms or production ML infrastructure is a plus.
-
Public technical writing or content creation that demonstrates the ability to explain complex concepts clearly.
Compensation & Benefits
Salary range: $125,000 to $190,000 USD annually.
Location
This role is fully remote. The primary office location is Munich, Bavaria, Germany.
Tips for this job
Practical Job and Scholarship guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Verification notes
Discovered directly from the employer’s public Ashby Job Postings API. The complete public role content and compensation metadata were normalized into safe candidate-facing sections.
Job and Scholarship is the discovery and verification layer. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Clera (ashby) ↗Browse current Job and Scholarship listings from Clera (ashby) →
