Vibeleaderboard
Index / tool
Visit github.com
Category
Developer Tools
Rank
No. 1545Tools index
Pricing
Open Source
Type
TOOL
GitHub
22 stars
Latest release
v0.11.6
Date

About

Prefixwise is a local proxy and CLI that sits between an agent and an LLM provider and names the cause of each prompt cache miss, such as tools sent in a different order. It prices the miss, can repair the request with an optimize flag, and can fail CI when a change would break the cache. It stores hashes and counts rather than prompts, and works with OpenAI, Anthropic, and vLLM.

Tags

llmprompt-cachingproxyai-agentstoken-costvllm

Tech Stack

PythonDocker

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.