We're happy to announce that AFM-4.5B is fully supported by the latest @intel OpenVINO 2025.3 release (https://t.co/pHxQCCuIKr)
You can now easily optimize and run AFM-4.5B on a wide range of Intel CPUs and GPUs, from devices to cloud instances.
If you'd like to quickly test, 16-bit, 8-bit, and 4-bit versions for OpenVINO are available on Hugging Face at https://t.co/oRv38ifCw5
➡️ AFM-4.5 launch blog post: https://t.co/4n6W8NQSdA
➡️ AFM-4.5B (original model): https://t.co/hTs1QUI5MB
--
Follow @arcee_ai for the latest news on small language models.
quantization — Shrinking a model by storing its numbers less precisely — like rounding — so it runs faster and fits on smaller hardware, at a small quality cost.
Why it matters
AFM-4.5B now runs on Intel CPUs and GPUs through OpenVINO 2025.3 with prebuilt 4-bit, 8-bit and 16-bit weights, an option when you need a small model off NVIDIA hardware.
