PicoLM

About

PicoLM is a C99 LLM inference engine supporting Llama-2, GPT-2, Qwen 3.6/3.8 (including MoE variants), and Gemma-3n models, built around heavy CPU SIMD acceleration and extreme cross-platform portability, running on everything from DOS and Tru64 Unix to the original iPhone and modern systems. It supports CUDA/HIP GPU acceleration with accelerated IMMA kernels, and version 1.0-rc2 adds a Vulkan backend alongside an expanded set of supported legacy platforms.