DwarfStar 4 (ds4)

About

DwarfStar 4 is a C inference engine by antirez for running DeepSeek V4 and V4.1 Flash, GLM 5.x and Qwen3.8 Flash Next locally on Metal, CUDA and ROCm machines. It uses asymmetric 2-bit quantization of the routed experts so large mixture-of-experts models fit on high-memory hardware, and it persists the KV cache to SSD so long prompt prefixes can be reloaded after a restart instead of recomputed. It ships a CLI, an OpenAI and Anthropic compatible API server, and a native coding agent.