Vibeleaderboard
← All Intel
Intel / video

Anthropic engineers on model upgrades, caching and cost per task

Source
video.twimg.com
Author
ClaudeDevs
Date
Why it matters

Upgrading models is a cost decision as much as a quality one. This explains how caching and mid-conversation effort changes affect spend, and why to re-tune your and track cost per task.

Terms in this piece · Glossary
  • prompt caching — Reusing the model's processed form of a repeated prompt prefix so subsequent calls skip re-reading it, cutting cost and latency substantially.
  • agent harness — The scaffolding around a model that turns it into a working agent — the loop, the tools it can call, and the rules for when to stop.
Read the source video.twimg.com
More from ClaudeDevs
Recommended reads
Comments

Checking sign-in…

Loading comments…