Vibeleaderboard
← All Intel
Intel / video

OpenAI o1 isn’t a chat model (and that’s the point)

Source
youtube.com
Author
Latent Space
Date

Context

In this Latent Space episode, Ben Hylak, author of the essay o1 isn't a chat model (and that's the point), explains how to OpenAI's o1 after a poor first try. The episode's template has four parts: the goal, the format wanted back, warnings about things to watch for, and a dump that should be far larger than feels natural. Hylak advises against telling the how to think, since it is trained to reason, and compares this to briefing a coworker: point out odd parts of the codebase rather than saying think slowly.

Hylak also stresses the return format. A second guest, who uses o1 mostly for coding, says concatenating the whole codebase into one text let it implement a complex feature in a single pass, and that asking for a diff instead of whole files made the output easier to bring into a project. These are users' reports from their own work, not tests, and Hylak notes that universal examples are hard to give.

Terms in this piece · Glossary
  • Model — A computational system that uses learned patterns to produce an output from information supplied to it.
  • Prompt — Information or instructions supplied to a model; in a chat, the request you type is often called your prompt.
  • Context and context window — Context is the information available for a generation; the context window is the capacity available to hold it.
  • File — A named unit of stored data that keeps its contents while no program is using it.
Read the source www.youtube.com
More from Latent Space
Recommended reads
Comments

Checking sign-in…

Loading comments…