OpenAI o1 isn’t a chat model (and that’s the point)
- Source
- youtube.com
- Author
- Latent Space
- Date
Context
In this Latent Space episode, Ben Hylak, author of the essay o1 isn't a chat model (and that's the point), explains how to OpenAI's o1 after a poor first try. The episode's template has four parts: the goal, the format wanted back, warnings about things to watch for, and a dump that should be far larger than feels natural. Hylak advises against telling the how to think, since it is trained to reason, and compares this to briefing a coworker: point out odd parts of the codebase rather than saying think slowly.
Hylak also stresses the return format. A second guest, who uses o1 mostly for coding, says concatenating the whole codebase into one text let it implement a complex feature in a single pass, and that asking for a diff instead of whole files made the output easier to bring into a project. These are users' reports from their own work, not tests, and Hylak notes that universal examples are hard to give.
- Model — A computational system that uses learned patterns to produce an output from information supplied to it.
- Prompt — Information or instructions supplied to a model; in a chat, the request you type is often called your prompt.
- Context and context window — Context is the information available for a generation; the context window is the capacity available to hold it.
- File — A named unit of stored data that keeps its contents while no program is using it.
Checking sign-in…
Loading comments…






