Export AI Gateway traces with Vercel Drains
- Source
- vercel.com
- Author
- Jerilyn Zheng
- Date
Context
Vercel's AI Gateway traces let teams examine how a model request was handled, including provider routing, retries, fallbacks, timing and cost. Pro and Enterprise teams can export those records through Drains to any endpoint compatible with the OTLP/HTTP telemetry protocol, which gives them records for investigating a slow or unexpectedly expensive request. Trace export announcement.
The exported traces exclude prompt and completion content. They therefore support investigation of request handling without including the conversation text in that export. Teams can also sample traffic to choose how many traces reach each destination, and Vercel charges for delivered traces on top of standard Drains data rates. Export contents and controls.
- model routing — Sending each request to a model chosen by the difficulty of the task, rather than using one model for everything.
- token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Checking sign-in…
Loading comments…