LiteRT-LM
github.com/google-ai-edge/litert-lm- Category
- AI Tools
- Pricing
- Open Source
- Type
- TOOL
- Builder
- google-ai-edge
- GitHub
- 6.0k stars
- Added
- Apr 17, 2026
About
Google's production-ready inference framework for deploying Large Language Models on edge devices like smartphones, IoT devices, and wearables. Enables on-device AI without requiring cloud connectivity, with hardware acceleration support for GPUs and NPUs.
Why it made the leaderboard
Google's framework for running LLMs on phones, IoT devices, and wearables with GPU/NPU acceleration — the same engine behind GenAI features in Chrome, Chromebook Plus, and Pixel Watch. On-device inference that has already shipped at production scale, not a research demo.
Tags
edge-aillminferencemobiletensorflowgemmaon-device
Tech Stack
PythonRustSwift
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.