Vibeleaderboard
← All Intel
Intel / video

AI prompt engineering in 2025: What works and what doesn’t | Sander Schulhoff

Source
youtube.com
Author
Lenny's Podcast
Date

Context

Sander Schulhoff, who wrote an early prompt engineering guide and ran a prompt-injection competition, says in a Lenny's Podcast interview with Lenny Rachitsky that prompt engineering still matters because each model release is predicted to end it and then does not. Schulhoff separates conversational use, refining answers over a chat, from product use, where one prompt runs on thousands of inputs and is tuned until fixed.

The example: for a medical coding startup, a first attempt with GPT-4 gave little to no accuracy. Adding a long list of documents that had been coded, each with the reasoning behind its codes, raised accuracy by about 70%, as Schulhoff recalls; the interview does not say whether that is a relative gain or percentage points. It is a single anecdote, but it shows the technique of putting worked examples in the prompt. For the security view, see another interview.

Terms in this piece · Glossary
  • prompt injection — An attack that hides instructions in content an AI will read — a webpage, email, or document — tricking it into following the attacker instead of the user.
Read the source www.youtube.com
More from Lenny's Podcast
Recommended reads
Comments

Checking sign-in…

Loading comments…