MLX Direct Decider
github.com/itsodeleo/mlx-direct-decider- Category
- Developer Tools
- Rank
- No. 3148Tools index
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 4 stars
- Date
About
MLX Direct Decider is a Python library that turns an existing MLX language model on Apple Silicon into a local decision engine without fine-tuning. Given application state, a request and allowed choices, it reads candidate logits from the model's original output head and returns a choice ID, no_match or abstain. It offers a Python API, CLI and local HTTP service, with experimental image support via MLX-VLM.
Tags
mlxapple-siliconsemantic-routinglocal-llmaction-selectionpython
Tech Stack
Python
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.