Overview
ABOUT THE ROLE
Full job description
ABOUT THE ROLE Lead the development of agent intelligence that helps mechanical engineers complete complex, multi-step workflows across desktop engineering software. As a hands-on technical lead on a small AI engineering team, you will shape the agent architecture, connect user research with product development, and improve the reliability and cost efficiency of real-world workflows. WHAT YOU'LL DO
- Own agent task success metrics, establish performance baselines, and systematically improve completion rates.
- Build rigorous, reproducible evaluation infrastructure grounded in validated user stories and real engineering workflows.
- Set per-task token budgets and track the cost of completed workflows.
- Work with researchers and engineering domain experts to map, interview about, and validate user workflows.
- Translate validated user stories into testable evaluations and prioritize workflow coverage by customer value and technical feasibility.
- Make architecture decisions across tool calling, state management, error recovery, model routing, and context management.
- Set technical direction for a small team, review designs and code, unblock teammates, and contribute production code.
- Collaborate with product, integrations, and customers to align agent behavior with real-world use. WHAT WE'RE LOOKING FOR
- At least 7 years of software engineering experience, including 2 or more years building and shipping LLM-based agents that take real-world actions.
- Deep experience with LLM application architecture, including model selection, context management, retrieval, tool calling, and orchestration.
- Strong Python skills and familiarity with function calling, tool APIs, tracing or observability, and evaluation tooling.
- Experience building benchmarks for task completion, cost efficiency, and failure analysis.
- Hands-on technical leadership and code review experience on a small engineering team.
- Experience applying AI or LLM tooling to proprietary engineering data or desktop engineering software, with background in mechanical engineering, CAD, CAE, PLM, or a related domain.
- Familiarity with desktop automation and enterprise workstation constraints is valuable. COMPENSATION & BENEFITS Salary range: $160,000 to $250,000 USD annually. Visa sponsorship is not available. LOCATION On-site in San Francisco, California, United States.
Tips for this job
Practical JobOpportunity guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Verification notes
laptop-ats-crawler v3
JobOpportunity is the discovery and verification layer. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Apply through JobOpportunity →