- Category
- Developer Tools
- Rank
- No. 2049Tools index
- Pricing
- Open Source
- Type
- TOOL
- Use case
- Models: Train & Run
- Interfaces
- CLI · Web
- Builder
- cactus-compute
- GitHub
- 12.8k stars
- Date
About
Needle is a 45M-parameter foundation model from Cactus Compute built specifically for tool calling, device control, and structured data extraction rather than open-ended chat. The whole model ships as a roughly 14MB binary and runs a full session in about 28MB of RAM, which puts function-calling agents on phones, wearables, smart-home hardware, and robots. It comes with a Python package, fine-tuning CLIs, and an export path for custom quantized builds.
Why it made the leaderboard
On-device tool calling at 14MB puts agent function-calling inside mobile and embedded targets that cannot host a hosted API round trip.
Intel on Needle
Tags
on-device-aismall-language-modeltool-callingedge-aiquantizationllmrobotics
Tech Stack
Python
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.