Unsloth adds CPU text training from the Train page, faster generation and more multi-GPU options, and links benchmarks of its DeepSeek-V4.1 GGUFs. Relevant if you fine-tuningTaking a trained model and training it a bit more on your own examples so it gets better at one specific job.Full definition → or run models locally.
Key takeaways · AI-distilled
Unsloth's Transformers backend now generates faster for supported single-GPU Llama and Qwen3 models on NVIDIA GPUs under Linux or WSL; in Unsloth's A100 test, 4-bit Qwen3-8B went from 25.7 to 99.1 tokens/s, a 3.9x speedup.
SDXL now renders under a 4 GiB VRAM budget, tested on T4 and L4 GPUs, and audio up to four hours long can be transcribed with audio.cpp, subject to upload and storage limits.
Supported non-quantizationShrinking a model by storing its numbers less precisely — like rounding — so it runs faster and fits on smaller hardware, at a small quality cost.Full definition → models larger than one GPU can now load by placing only each GPU's assigned pipeline layers, and UNSLOTH_PARALLEL configures supported combinations of data, tensor, pipeline and context windowThe maximum amount of text a model can consider at once — its working memory for the current conversation or task.Full definition → parallelism.
unsloth.tile_mlp(model) reduces MLP activation memory during training, and audio vision models such as Gemma 3n and Gemma 4 can now be fine-tuned on datasets that mix audio and images.
On Mac, the experimental Fast Verify option speeds generation for supported MLX speculative decodingA speed trick where a small model drafts several tokens ahead and the big model verifies them in one pass, often doubling generation speed.Full definition → models, with the stated caveat that replies may differ slightly.
Terms in this piece · Glossary
fine-tuning — Taking a trained model and training it a bit more on your own examples so it gets better at one specific job.
quantization — Shrinking a model by storing its numbers less precisely — like rounding — so it runs faster and fits on smaller hardware, at a small quality cost.
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
speculative decoding — A speed trick where a small model drafts several tokens ahead and the big model verifies them in one pass, often doubling generation speed.
