How a Trading Firm Ships New AI Models the Same Day - Noyan Tokgozoglu, Optiver
Source
youtube.com
Author
AI Engineer
Date
Why it matters
Shows how a production firm adopts new models within a day using internal golden sets, and how it keeps spend in check through a gateway with routing and budgets.
Terms in this piece · Glossary
inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
agent harness — The scaffolding around a model that turns it into a working agent — the loop, the tools it can call, and the rules for when to stop.