Source-listed Job

AI Harness Engineer, Agentic & Autonomous Operations

About the Role Build the software systems that turn language models into reliable agents for operational work. Working closely with engineering and leadership, you will shape agent architecture from design through production opera...

Job Source description available
Clera (ashby) Berlin, Germany Source published Oct 22, 2026 Source retrieved Oct 22, 2026
Source: Clera (ashby) · A retrieval date records when our system last obtained the source record. It does not guarantee the vacancy is still open or that every detail has been independently checked.
Description from the source The source description is formatted below for discovery. The provider owns the original wording and may change its requirements or close applications.
EmploymentFull Time
CountryGermany
DepartmentEngineering

Overview

About the Role Build the software systems that turn language models into reliable agents for operational work. Working closely with engineering and leadership, you will shape agent architecture from design through production operations. What You'll Do Design orchestration, context assembly, and execution layers for reliable agents. Build systems for task decomposition, state management, model selection, execution loops, checkpoints, retries, and human handoffs. Connect agents to APIs and operational systems using explicit tool contracts, permissions, validation, and outcome verification. Develop retrieval, memory, and knowledge-maintenance strategies that balance relevance, latency, and cost. Create evaluation suites and automated tests for decision quality, tool use, task completion, safety, and failure patterns. Make agent behavior inspectable with structured traces, state, outcomes, a

Full job description

Full Job Description

About the Role

Build the software systems that turn language models into reliable agents for operational work. Working closely with engineering and leadership, you will shape agent architecture from design through production operations.

What You'll Do

  • Design orchestration, context assembly, and execution layers for reliable agents.

  • Build systems for task decomposition, state management, model selection, execution loops, checkpoints, retries, and human handoffs.

  • Connect agents to APIs and operational systems using explicit tool contracts, permissions, validation, and outcome verification.

  • Develop retrieval, memory, and knowledge-maintenance strategies that balance relevance, latency, and cost.

  • Create evaluation suites and automated tests for decision quality, tool use, task completion, safety, and failure patterns.

  • Make agent behavior inspectable with structured traces, state, outcomes, and error classifications.

  • Use evaluations, production traces, and controlled experiments to improve prompts, context, tools, and architecture.

  • Ship and operate production Python software, investigating incidents and making architectural decisions with the engineering team.

What We're Looking For

  • At least 2 years of professional software engineering experience and strong production software engineering fundamentals.

  • Experience building, testing, and operating reliable production systems in Python.

  • Substantial experience building LLM-powered automation, workflow, or decision systems beyond notebooks, chat interfaces, or basic retrieval pipelines.

  • Practical knowledge of LLM orchestration, state management, context assembly, structured outputs, permissions, retries, fallbacks, observability, and evaluations.

  • Experience connecting models to real work through relevant evidence, bounded decisions, tool or API use, and verification of outcomes.

  • Sound judgment designing for uncertainty and partial failure, including when systems should act, retry, stop, or escalate.

  • A systematic approach to evaluation using representative cases, traces, outcome checks, and regression tests.

  • Experience shipping and supporting software used by people or operational processes, including debugging timeouts, inconsistent data, changing APIs, and production incidents.

  • Workflow engines, distributed systems, developer tools, automation platforms, or integration-heavy backend experience is valuable.

Location

On-site in Berlin, Germany. Visa sponsorship is not available.

Tips for this job

Practical JobOpportunity guidance. These tips do not replace official rules or create new eligibility requirements.

  1. Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
  2. Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
  3. Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
  4. Apply through the original employer or official recruitment destination shown on this page.
Original authoritative source

JobOpportunity.info helps you discover and organize source listings. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.

Apply through JobOpportunity →

Browse current JobOpportunity listings from Clera (ashby) →

More ways to save

Discover deals, coupons and free courses on our sister site.

Explore DealVorio
Save more with DealVorio: deals, coupons, free courses, apps and books