llmspeed

About

llmspeed lets you pick a GPU, Mac or CPU and a local model, then streams a simulated answer at the predicted tokens per second after a realistic time to first token. It also has a race mode for comparing two setups and a memory-fit check showing whether a model loads at each quantization. Each estimate is labeled measured, derived or projected, so readers know how much to trust it before buying hardware.