← All IntelClip / EntertainmentPrecompute via generated programs vs real-time inference
From Boris Cherny: Claude Code & the Future of Engineering | Acquired Unplugged · ≈18:45
“I'll ask it questions that require a lot of data analysis and I can see like oh it's it's writing some software right now to do the analysis and then it's going to write a bunch of html and CSS and JavaScript and then render a brand new UI for me to play with it in.”
“Do you want to do it in real time when you sample from the model and kind of do inference or do you want to kind of premputee so you can have the model write a program and then you can run that program repeatedly and that's free for you.”
What’s in it
- Why chat-window Python is cannibalizing dedicated coding tools
- The tradeoff: real-time inference vs. reusable model-written programs
- How models render custom UIs on the fly for data analysis
Clip transcript
claud code usage has dropped because of how much Python gets written in claude the chat window. I'll ask it questions that require a lot of data analysis and I can see like oh it's it's writing some software right now to do the analysis and then it's going to write a bunch of html and CSS and JavaScript and then render a brand new UI for me to play with it in. And that used a lot of claude code generation although I never once interacted with claude code the product to to have that be accomplished. Yeah. Yeah. There there's this kind of interesting kind of theoretical thing about like when do you want to do the computation? Do you want to do it in real time when you sample from the model and kind of do inference or do you want to kind of premputee so you can have the model write a program and then you can run that program repeatedly and that's free for you. And essentially we want to do the latter as much as possible. Um, but really it's up to the model,
Comments
Sign in to comment.
Loading comments…