AI Gateway now supports TypeSafe clients and an HTTP API for Jev
Source
Rohan Taneja
Author
Rohan Taneja
Date
Key takeaways · AI-distilled
Existing TypeSafe clients migrate by changing only the base URL and API key - evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition → calls (state in, questions asked, response shape) stay exactly as they were before pointing at the gateway.
Jev returns typed answers with attached probabilities rather than generated text to parse, since it's built as a probabilistic decision model rather than a chat/completion model.
New integrations pick from three question types: boolean returns a 0-1 probability, choice picks one option from a named set, and score rates against a caller-defined scale.
eve, a framework for building agents with sandboxAn isolated environment where AI-generated code or agent actions run without being able to touch anything real.Full definition → compute and human approvals, uses Jev as its default evaluation model for automatic model selection and automated tool approvals.
Terms in this piece · Glossary
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
sandbox — An isolated environment where AI-generated code or agent actions run without being able to touch anything real.
Why it matters
Teams already using a typed decision-model client can route those calls through the gateway by swapping only the base URL, and any language can call it directly over HTTP, unifying billing and observability with other model calls.
