← Back to Leaderboard
AI ToolsTOOL
About
Andrej Karpathy's minimal, clean implementation of Byte Pair Encoding (BPE) — the tokenization algorithm used by GPT and most modern LLMs.
Tags
bpetokenizerkarpathyllmeducation
Tech Stack
Python
Comments
No comments yet.