bytesized
github.com/utsav1033/bytesized- Category
- AI Tools
- Type
- TOOL
- Date
About
A freestanding C program, under 3 KB, that runs the SmolLM2-135M language model and produces the same greedy tokens as Hugging Face transformers. It reads the original model weights and tokenizer files directly with no converter and no standard library, using a self-unpacking compressed binary. It is an experiment in how small a working LLM engine can be.
Tags
llminferencectinysmollm2arm64
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.