LLMBrake
github.com/llmbrake/llmbrake- Category
- Developer Tools
- Rank
- No. 2193Tools index
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 1 stars
- Date
About
LLMBrake is a small TypeScript library that wraps OpenAI-compatible chat completion calls and tracks each customer's monthly spend in USD from the token usage the provider returns. Near a customer's budget it switches requests to a cheaper model, and at the budget it throws an error before the request reaches the provider. This keeps one heavy user from running up an unbounded API bill.
Why it made the leaderboard
Caps each customer's monthly LLM spend: switches them to a cheaper model near the limit and blocks calls before they reach the provider at the cap. Runs in-app, not as a proxy.
Tags
llmbudgetopenaicost-controltypescriptnpm
Tech Stack
Node.jsTypeScript
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.