Laya MPS
github.com/afshinm/laya-mps- Category
- Developer Tools
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 4 stars
- Date
About
Laya MPS runs a small typed-decision model locally on Apple Silicon Macs using Metal Performance Shaders, choosing among options, scoring inputs, or estimating whether statements are true rather than generating open-ended text. Its English model is tuned for customer service, invoices, security incidents, and agent traces, running at roughly 32ms median latency using about 2.1GB of RAM (or ~0.74GB in a lower-memory mode) on an M5 Pro.
Why it made the leaderboard
Lets developers get typed, low-latency decisions like routing or urgency scoring on-device, without paying LLM API latency or cost for narrow classification tasks.
Tags
local-aiapple-siliconclassificationmpson-device-ai
Tech Stack
Python
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.