Scaling up Continual Learning — Ronak Malde, Trajectory
Source
AI Engineer
Author
AI Engineer
Published
Terms in this piece · Glossary
distillation — Training a small, cheap model to imitate a big one's outputs, keeping much of the capability at a fraction of the cost.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
Why it matters
Long-horizon AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → training has a specific, reproducible failure mode here, along with the corrections that keep it from collapsing into hedging.
videoDesigning Agents (The Floor Is the Frontier) — Ben Hylak, Raindrop
videoImproving Agents is a Data Mining Problem — Vivek Trivedy, LangChain
videoLessons from Studying Every Memory System — Shlok Khemani, Independent
videoBeyond Static Intelligence: Evaluating Continual Learning — Parth Asawa, UC Berkeley
