What Dropbox has learned from deploying AI at company scale
Source
Dropbox Team
Author
Dropbox Team
Date
Key takeaways · AI-distilled
Dropbox CTO Ali Dasdan says giving people AI tools is only the first step: new bottlenecks emerge, such as too many code reviews or extra load on development infrastructure, so the workflow has to be re-examined end to end.
Dropbox says about 70% of its code is now AI-generated, close to a figure Uber shared, and it runs coding agents through an internal service called Nova.
Dropbox reports pull request throughput in the top 5% of a custom benchmarkA standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.Full definition → of peers with large, complex codebases, a change failure rate in line with peers at the 75th percentile, and tokenThe chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.Full definition → usage among the lowest in that group.
Dasdan treats revenue, cost, customer satisfaction and retention as the real ROI, tracked through proxy metrics grouped under speed, effectiveness, quality and impact. Nova lets Dropbox tie token spend to the engineering work it produced.
Uma Namasivayam says leadership mandates alone do not drive adoption: Dropbox paired them with boot camps and show-and-tells, and aligned incentives so managers could see the return.
Terms in this piece · Glossary
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Why it matters
A first-party account of what breaks when a company scales AI usage beyond pilots, useful for teams trying to translate raw model access into measurable productivity gains instead of just more output.
articleBeyond code generation: rethinking engineering productivity in the age of AI agentsIlya Yakovlev,Andrew Cheung,Binoy Dash,Simran Jumani,Dmitriy Meyerzon,Mark Breitenbach,Ishan Mishra,Kazuaki Okumura
postWhy Bottom-Up AI Pilots Stall and Workflow Redesign Doesn'tAndrew Ng