Our Latest research paper(preprint) on loops and graph is live on ArXiv
- Source
- arxiv.org
- Author
- vpbhardwaj
- Date
Many agent harnesses wrap work in a loop that repeats until a check passes. This preprint formalizes that pattern as three parts: the worker, a gate the worker cannot modify, and a budget declared before the run. Under those conditions the authors prove the loop terminates even when it includes repair steps. They measure gate quality with mutant corpora, deliberately broken outputs that a working gate should reject. Applied to 69 loops found in shipped systems, the audit flagged 47 vacuous gates, checks that pass regardless of the work. The practical design they propose is an independent gate, a global repair budget and a spending ceiling set before the run starts. If your agent's definition of done is a test or validator it can edit, or one that never fails, the loop's guarantees are weaker than they look.

Context
An saying it has finished is a weak completion check. Bounded Loops proposes separating the worker from a checker it cannot modify, with a declared budget governing attempts and repairs. Completion requires the checker's recorded approval, while spending limits apply during an attempt.
The checker itself still needs testing. The authors report that checks which rejected every deliberately broken example in one test collection accepted failures from a fresh collection. The useful contribution is a way to control execution and examine completion checks, rather than treating an agent's confidence or an exhausted test set as proof of success.
- AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
articleLoop Engineering: Building Blocks, Adoption, and ImpactJai Lal Lulla, Vahram Nersesyan, Seyedmoein Mohsenimofidi, Christoph Treude, Sebastian Baltes
articleLoopsBench: From Harness Engineering to Loop Engineering in Benchmarking Coding AgentHan Li, Zhemin Fang, Rili Feng, Yingqi Zhao, Jiaheng Liu, Pengfei Gao, He Ye, Dayi Lin, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang
postFifteen agent loops people actually run, and how to cap themMatt Van Horn
Checking sign-in…
Loading comments…