Vibeleaderboard
← All Intel
Intel / article

What Is Jev

Source
openrouter.ai
Author
OpenRouter editorial sitemap
Date

Context

This OpenRouter explainer answers what a decision model is and how to read what it returns, using Jev from TypeSafe as the example (openrouter.ai). A decision model reads text, and in Jev's latest version images, but never writes any. The developer supplies the input plus a typed question, and the model answers only from options defined in advance. Jev handles four question types: Choice picks one option from a set and gives a probability for each; Score places the input on ordered levels the developer describes; Noul returns the probability that a yes-or-no statement is true; and Box, which works on images, returns the edges of a box around a described target. Because nothing free-form comes back, there is no text to parse. The post also lists what Jev leaves to the developer: it writes no explanations or reasoning, makes no tool calls or multi-step plans, and is not meant for exact arithmetic or date math, which should be computed first.

The useful part is how to read the numbers. TypeSafe Jev so that answers given at 0.8 are right about 80 percent of the time, but the post stresses that this holds only on average across many answers; any single one can still be wrong. A Noul near 0.5 means the model is genuinely unsure, and the author suggests treating it as a third outcome to follow up on or hand to a person. The confidence figure on Choice and Score answers measures how concentrated the probabilities are, not whether the chosen option is correct. Box always returns a box, even when the target is absent, so the post suggests asking a Noul about the target in the same request. Thresholds should come from a few hundred of a team's own labeled examples. Jev is proprietary, with no published weights or paper, and as of October 16 OpenRouter listed 21 decision models from 13 makers behind the same Decisions API. A companion post shows Jev and an working together on support tickets.

Key takeaways · AI-distilled
  • TypeSafe says Jev is calibrated so that a 0.8 answer is right about 80% of the time for that kind of answer, but only on average across many answers; any single answer can still be wrong.
  • Jev answers four question types, called primitives: Choice, Score, Noul and Box. A request has two parts: state, the text or images to evaluate, and a questions object with one or more typed questions.
  • Since Jev 1.14 the model accepts images as well as text, but per the post's comparison table it does not take audio or video input.
  • On OpenRouter, Jev costs $0.042 per million input and output is free, according to the post.
  • The post frames Jev and LLMs as complementary: use an LLM when words are the output, such as a reply or code patch, and Jev for code-actionable decisions like routing and verification.
Terms in this piece · Glossary
  • calibration — How well a model's confidence matches reality — a calibrated model saying "90% sure" is right about 90% of the time.
  • LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
  • token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Read the source openrouter.ai
More from OpenRouter editorial sitemap
Recommended reads
Comments

Checking sign-in…

Loading comments…