AI Gateway User Insights flags model overuse by task, model and user
Source
cfl.re
Author
Cloudflare
Date
Why it matters
Teams routing LLMA large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.Full definition → traffic through AI Gateway can now see which tasks, models and users drive spend, so they can move simple work to cheaper models. It is free for AI Gateway users.
Terms in this piece · Glossary
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
postCloudflare AI Search goes GA with image embeddings and PDF OCR
articleWe are introducing Clef and Clef-flash, open-source decision models hosted on…
articleToday, we’re making the Cloudflare Monetization Gateway available as part of a…
articleCloudflare Auto Router picks cheaper models per request in AI Gateway
