Vibeleaderboard
← All Intel
Intel / article

Tokens too cheap to meter

Source
jyn.dev
Author
teoruiz
Date

Context

An AI model's price per does not tell you what completing a job will cost. A cheaper model may generate more text to finish the same task, while a more capable model may finish with less work. The essay makes this distinction central to its argument that useful AI computation is becoming cheaper.

Its broader prediction is that inexpensive model decisions will become ordinary software components, including inside search and scheduling tools. That is a forecast about how developers might use falling task costs. Evaluating it requires comparing the cost of completing the same work at an acceptable quality, rather than comparing advertised text-generation prices alone.

Terms in this piece · Glossary
  • token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
  • inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Recommended reads
Comments

Checking sign-in…

Loading comments…