llm-openai-decisions 0.1a0
- Source
- simonwillison.net
- Date
Context
Simon Willison released an alpha plugin for his that calls OpenAI's Decisions API, a service that answers a question about text or an image with a typed result and a probability instead of prose. He had GPT-6 Astra read the API documentation and write the plugin, modeled on an earlier one he built for Jev, the comparable model from TypeSafe AI.
His comparison is the useful part. OpenAI's gpt-6-luna decision model accepts images as well as text, while Jev, by his account, takes text. Both charge only for input: 10 cents per million input tokens for OpenAI and 4.2 cents for Jev. Both support three question types, yes or no, a choice from options, and a score.
His example asks whether an attached image (a named two-pelicans.jpg) contains any mammals and gets back a predicate result with a probability of 0.0. That shows the output shape from one test, not how accurate the model is. The release is version 0.1a0, an early alpha.
- Unlike Jev, OpenAI's gpt-6-luna decision model accepts image input as well as text, Willison notes.
- Both services bill only input tokens and charge nothing for output: OpenAI at 10 cents per million input tokens, Jev at 4.2 cents per million.
- OpenAI's API mirrors Jev's shape with the same three question types: yes/no predicates, choices and scores. A yes/no query returns a JSON object with a probability .
- Willison had GPT-6 Astra read OpenAI's new API documentation and build the plugin, modeled on his existing llm-typesafe plugin for Jev.
- Large language model — A model trained on large amounts of data to process and generate language.
- CLI tool — A command-line capability an agent can discover and compose through shell commands.
- File — A named unit of stored data that keeps its contents while no program is using it.
- Field — One named piece of a record, such as name or approved_on; a record is one entity's set of values, one per field.
Checking sign-in…
Loading comments…