Prefixwise
github.com/tejachavali/prefixwise- Category
- Developer Tools
- Rank
- No. 1545Tools index
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 22 stars
- Latest release
- v0.11.6
- Date
About
Prefixwise is a local proxy and CLI that sits between an agent and an LLM provider and names the cause of each prompt cache miss, such as tools sent in a different order. It prices the miss, can repair the request with an optimize flag, and can fail CI when a change would break the cache. It stores hashes and counts rather than prompts, and works with OpenAI, Anthropic, and vLLM.
Tags
llmprompt-cachingproxyai-agentstoken-costvllm
Tech Stack
PythonDocker
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.