Vibeleaderboard
← All Intel
Intel / post

AI Memory Management Philosophy

Source
x.com
Author
Matt Van HornTop Viber
Date

Context

An 's useful lessons need a place where they will affect the next relevant task. Matt Van Horn describes auditing 218 memory files and finding that many held durable lessons tied to a single , a reusable set of agent instructions. The proposed fix is to move each lesson into that skill through a reviewed change, where it is version-controlled and shared, while keeping always-loaded instructions short.

The distinction is about loading. Files such as CLAUDE.md enter every session and compete for , so Van Horn keeps only rules that apply across tasks there and treats on-demand retrieval as a separate kind of memory. The same habit appears in the Claude Code team's retrospective, where the agent is told to update a development skill after resolving an environment problem.

Key takeaways · AI-distilled
  • The real distinction is always-loaded versus queried-on-demand. Wanting memory is correct; the error is answering it by injecting more text into every session instead of letting the agent search a store when it needs one.
  • The bloat had stopped working before anyone noticed. A 46KB memory index exceeded what the would inject, so the back half was silently dropped each session — a file steering nothing while still costing tokens.
  • Standing instructions get injected at session start, which puts the practical ceiling around 200 lines per file. Past that, more text buys worse adherence rather than more knowledge.
Terms in this piece · Glossary
  • AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
  • agent skill — A reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.
  • context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
  • agent harness — The scaffolding around a model that turns it into a working agent — the loop, the tools it can call, and the rules for when to stop.
Key quotes

“A memory with no budget is not a brain, it is a landfill.”

“Hard limits on memory force an AI agent to distill what actually matters. Enforced scarcity is the mechanism that creates focused, useful long-term memory instead of bloated, useless context.”

aidecipher

“The default behavior of Claude Code is, when you start a session, it injects the full claude.md, and that is why we want to keep the claude.md ideally under 200 lines.”

Simon Scrapes

“the longer you let Claude's context clog up, the dumber it gets”

More from Matt Van Horn
Recommended reads
Comments

Checking sign-in…

Loading comments…