- Category
- Developer Tools
- Rank
- No. 3105Tools index
- Pricing
- Open Source
- Type
- TOOL
- Use case
- Data Processing · Models: Train & Run
- GitHub
- 31 stars
- Latest release
- v0.11.1
- Date
About
STROT is a Python library that uses an LLM once, at compile time, to generate a frozen decision artifact for tasks such as classification, scoring and routing. At runtime a small local decision model (144M parameters, CPU) handles each record, returns typed JSON with probabilities and confidence, and abstains when confidence is low. This avoids per-record LLM calls and their cost and latency.
Tags
llmclassificationroutingcompilerpythonlocal-inference
Tech Stack
Python
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.