← Research

Harness Gains Are Linear in Residual Error: A Weak-to-Strong Headroom Law Forecasts Claude Opus 5.5 from Weaker Claude Models

Lindell S. Cumes QWNTL Labs

PDF · 19 pages · 430 KB

A share of residual error fitted on weaker models forecasts Claude Opus 5.5.
Figure 1. A share of residual error fitted on weaker models forecasts Claude Opus 5.5. (a) Lift of a harness component over a no-harness control against the control’s residual error h = 100 − m, in points on a 0–100 scale, for the six Claude Haiku 4.5 and Claude Opus 4.8 comparisons the share is fitted on and the 15 Claude Opus 5.5 comparisons held out of the fit. The blue line is the headroom law with the share fitted on the six weaker comparisons alone, k = 0.38. The grey lines are a constant gain and a constant gain capped at the headroom, fitted on the same six comparisons, and the black line at zero is the no-effect alternative. Bars are 95% intervals from each comparison’s standard error. (b) Out-of-sample mean absolute error of each forecast on the 15 Claude Opus 5.5 comparisons, and the law’s Bayes factor against each alternative. Plotted from the released comparison record.

Abstract

RRSI, Harness2, and other self-improvement methods report a harness’s gain in points on the model they ran it on, and none of them predicts that gain on another model. The Last AI Built by Humans illustrates self-improvement closing 0.78 of the remaining headroom without fitting that share. The headroom law states that a harness component’s lift over the same model without it is a share k of that model’s residual error. For a model that scores m points of task success, the lift is Δ = k (100 − m) points, and k is the fraction of the model’s failures whose cause the component supplies, weighted by how often it converts them. Fitted on six Claude Haiku 4.5 and Claude Opus 4.8 comparisons alone, the law forecasts 15 Claude Opus 5.5 comparisons, 13 of them on AppWorld, with a mean absolute error of 3.3 points against 5.2 for a constant gain. Its Bayes factor against no effect is 186. Against a constant gain it is 9.8, and against a capped gain 5.6. It is the first law that predicts the lift of an agent-harness component over the same model without it before the component runs on that model. Fitted on Claude Opus 5.5 alone, the share is 0.54 (95% CI 0.43–0.68). Its AIC is 77.2, against 96.8 for a constant gain. Harness variants that a self-improvement loop selected on a weaker model converted that model’s failures, and their selection scores on Claude Haiku 4.5 predict Claude Opus 5.5 gains at Spearman 0.16. On ALE-Bench, Claude Opus 5.5 ranks a port of ACE above ports of the Darwin and Huxley-Gödel Machines. We release the 195-comparison record with some free text removed, together with the code and the forecasts.

Code and data

Comparison record: 195 comparisons (ledger.csv; free text removed on 47 rows; agent and team names replaced by neutral IDs; internal references removed)

Fit and forecasts

Alternatives, coupling and recount

Cite

@misc{cumes2026harness,
  title         = {{Harness Gains Are Linear in Residual Error: A Weak-to-Strong Headroom Law Forecasts Claude Opus 5.5 from Weaker Claude Models}},
  author        = {Cumes, Lindell S.},
  year          = {2026},
  url           = {https://qwntl.com/paper-frontier-report}
}
Continue reading →