Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint
Source
JonSchneider
Author
JonSchneider
Date
Terms in this piece · Glossary
multimodal — A model that works with more than text — reading images, audio, or video, and sometimes generating them too.
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
tool use — A model's ability to call external functions — run code, search the web, edit files — instead of only generating text.
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
Why it matters
Makes a capable 27B-class model deployable locally in under 6GB, a real option for running strong coding and agentic performance on hardware that can't fit the full-precision model.
