OpenAI Decisions API targets sub-second constrained decisions with vision
- Source
- x.com
- Date
Decisions API, for lightning fast constrained decision making powered by Luna. Supports visual inputs, and tuned to be able to make decisions in less than a few hundreds of milliseconds end to end.
Context
OpenAI's Decisions API targets small decisions that would otherwise make an application wait. Its initial announcement describes a Luna-powered service with visual input support, tuned to decide in under a few hundred milliseconds end to end.
Subsequent API documentation illustrates the idea with complaint routing: a developer supplies the possible categories, such as billing or shipping, and the service selects one for a complaint. The output gives software a bounded choice it can act on. The announcement's latency language describes a tuning target, rather than a published measurement for every request.
Checking sign-in…
Loading comments…