Vibeleaderboard
← All Intel
Intel / article

The Shape of AI: Jaggedness, Bottlenecks and Salients

Source
oneusefulthing.org
Author
Ethan Mollick
Date

Context

Improving one weak step can make an AI workflow useful while leaving the wider job unfinished. Ethan Mollick illustrates this with presentations: summarizing source material was already possible, but producing useful visuals remained an obstacle. Mollick describes NotebookLM generating slides as complete images, opening up presentation styles that earlier code-built decks struggled to achieve. The wider argument concerns the remaining tasks. Consulting also requires gathering information, securing agreement, and interpreting unwritten requirements. Better slides remove one constraint; the rest of that work still determines whether the assignment succeeds.

Key takeaways · AI-distilled
  • Properly scaffolded, GPT-4.1 reproduced and updated an entire issue of 12 Cochrane medical reviews in two days, roughly 12 work-years of effort. It screened over 146,000 citations, extracted data, ran the statistics, and beat human reviewers on accuracy.
  • What blocked full automation of that review pipeline was mundane: the model could not open supplementary files or email authors for unpublished data. Those account for under 1% of errors, and they still force an expert human into the loop.
  • Speeding up discovery just relocates the constraint. If AI finds drug candidates ten times faster, the binding limit becomes patient recruitment and FDA review. The bottleneck migrates from intelligence to institutions, and institutions move at institution speed.
  • Historian Thomas Hughes called the single problem stalling an entire system a "reverse salient." It explains why AI progress looks stuck and then lurches: labs concentrate on the one blocking weakness, the way math ability jumped once it became the obvious barrier.
  • AI slide decks were bad because the model had to write code to build them. NotebookLM paired with Nano Banana Pro renders each slide as a single image instead, which only became viable at high image quality, so visual style turns into a prompt rather than a template.
Key quotes

“The bottleneck migrates from intelligence to institutions, and institutions move at institution speed.”

“reproduced and updated an entire issue of Cochrane reviews (n=12) in two days, representing approximately 12 work-years of traditional systematic review work.”

“So far, every lurch forward leaves yet more edges in which humans are needed.”

Read the source www.oneusefulthing.org
More from Ethan Mollick
Recommended reads
Comments

Checking sign-in…

Loading comments…