Clip transcript
it's remarkable um you basically still have to be in charge of the aesthetics, the the judgment, the taste, and a little bit of oversight. And maybe one one of my favorite examples of like the the weirdness of agents is um for menu gen, you sign up with a Google Google account, but you purchase credits using a Stripe account and both of them have email addresses. And my agent actually tries to basically um like when you purchase credits, it assigned it using the email address from Stripe to the Google email address. Like there wasn't a persistent user ID that that for people. It was trying to match up the email addresses, but you could use different email address for your Stripe and your Google and basically would not associate the funds. And so this is the kind of thing that these agents still will make mistakes about. It's like why would you use email addresses to try to cross-correlate the funds? They can be arbitrary. You can use different emails, etc. Like this is such a weird thing to do. So I think people have to be in charge of this spec, this plan, and actually don't even like the plan mode. I would I mean, obviously it's very useful, but I think there's something more general here where you have to work with your agent to design a spec that is very detailed and maybe it's a maybe basically the docs and then get the agents to write them. And you're in charge of the oversight and the top-level categories, but the agents are doing a lot of the under the hood. And so I think you're not caring about some of the details. So as an example also with um, a race or tensors in neural networks, um, there's a ton of details between PyTorch and NumPy and all the different like pandas and so on for all the different little API details. And I'll I already forgot about the keep dims versus keep dim or whether it's dim or axis or reshape or permute or transpose. I don't remember this stuff anymore, right? Because you don't have to. This is the kind of details that are handled by the intern because they have very good recall. And but you still have to know for example that um, you know, there's underlying tensor, there's an underlying view and then you can view of the same storage or you can have different storage which will be less efficient. As we still have to have an understanding of what this stuff is doing and some of the fundamentals um, so that you're not copying memory around unnecessarily and so on. But uh, the details of the APIs are now handed off. So it um, you're in charge of the taste, the engineering, the design uh, and that it makes sense and that you're asking for the right things and that you're saying that okay, that these have to be unique user IDs that we're going to tie everything to. Um, and so you're doing some of the design and development and the engineers are doing the fill in the blanks. And that's currently kind of like where we