Vibeleaderboard
← All Intel
Intel / video

Al Engineering 101 with Chip Huyen (Nvidia, Stanford, Netflix)

Source
youtube.com
Author
Lenny's Podcast
Date

Context

Chip Huyen, author of the book AI Engineering, argues that teams building AI applications spend effort on the wrong things. On Lenny's Podcast she discussed a table she posted contrasting what people expect to improve an AI with what she says does.

The expected fixes on her list are following the latest AI news, adopting the newest framework, agonising over vector databases, constantly comparing which is smartest, and . What she says works is talking to users, building more reliable platforms, preparing better data, optimizing end-to-end workflows and writing better prompts. Her reasoning on technology choices is practical: she asks teams how much improvement an optimal choice would bring over an adequate one, and how hard an untested technology would be to switch away from later. If the gain is small and switching is costly, she says, the debate is not worth the time.

This is practitioner advice from her work with companies, not a controlled study.

Terms in this piece · Glossary
  • Application — Software arranged so that a person can use it; in this course, the software around a model that accepts your request, prepares the context and shows the reply.
  • Agent — A system in which a model repeatedly chooses operations, a harness carries them out, and the results return to the model to inform its next choice.
  • Model — A computational system that uses learned patterns to produce an output from information supplied to it.
  • fine-tuning — Taking a trained model and training it a bit more on your own examples so it gets better at one specific job.
Read the source www.youtube.com
More from Lenny's Podcast
Recommended reads
Comments

Checking sign-in…

Loading comments…