The Death of Developer Advocates — Stephanie Jarmak, Sourcegraph
Source
AI Engineer
Author
AI Engineer
Date
Terms in this piece · Glossary
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Why it matters
Agents recommend tools when you're being shopped for, not when a user describes their actual pain — a gap invisible unless you benchmarkA standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.Full definition → it. Tool descriptions and tokenThe chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.Full definition → cost are now part of how your product gets judged.
