Research

Our research studies durability: how AI systems keep the rules they are given across long work, and how what they learn can outlast any one agent or model.

Papers

Measuring what durability adds to frontier models

We held the base model fixed and measured what durability alone changes over month-long professional work.

Can what an agent learns outlive it?

A study protocol for four worlds of a hundred agents each, to test whether knowledge and skill survive the agents that hold them.

Measuring when agents forget the rules they were given

Experiments on frontier models from Anthropic and Google show that an agent loses a rule at one moment: when it leaves the context window.

A technical summary of Nenya

The July results in five pages: the problems long-running agents meet, and what changes when their commitments are kept in force.

Why agents get pulled back from production

Agents are often withdrawn after they reach customers. We trace the cause to commitments that slip over the length of real work.

Why capability isn’t what limits long-running agents

Frontier models have capability to spare. What long, regulated work lacks is fidelity to the rules a model knows, held over time.

Two ways agents break the rules they were given

Agents fail rules in two different ways: they lose them, or they keep them and act against them. Each needs its own remedy.

Holding an agent to a month of growing obligations

A thirty-day model of five professional fields asks whether an agent can carry a growing load of obligations without losing coherence.

Holding a closed frontier model to hard rules

A frontier model can be held to hard rules from the outside, with formal guarantees, as long as checking them is compulsory.

Continue reading →