← All IntelClip / OtherThe 'mismanaged genius' problem and open-model customization
From Local Models: Trust, Control, Optimization — Carter Abdallah, NVIDIA · ≈17:28
“But nothing will let you get the the the level of customization or customizability that you can achieve with open models.”
“We're we're leaving a lot of like a lot of important capability on the table because we're just not we're not fitting the models into the harness, right?”
What’s in it
- Argues open model weights enable deeper customization than closed APIs
- Introduces the 'mismanaged genius' problem: wasted capability from generic tuning
- Explains why matching a model to its specific harness boosts performance
Clip transcript
>> Well, that's something I think that's really important to just like reiterate, right? I mean, like Nemotron's great, I love it. Trinity's great, I love it. Like we design a model that's supposed to be as good as it can be across a number of harnesses, right? You can see this in the technical report. The idea is like we want the the model to work as well as it can in Pi compared to you know Hermes compared whatever you're using, right? But like you're you're not using all of these tools at once. You're using one of these tools. And so when you have open models, you can do things like news research can create a post train of whatever model for their harness, right? That you know will be extra good. And you know, this this this thing from from from you know, I I can't remember who who who originally wrote it, but this idea of like the mismanaged genius, right? We're we're leaving a lot of like a lot of important capability on the table because we're just not we're not fitting the models into the harness, right? You can do a bunch of stuff with closed models. Like you can change your prompts and your skills and all kinds of other nido things, right? But nothing will let you get the the the level of customization or customizability that you can achieve with open models. And I think that is something that is going to become increasingly and increasingly more important, especially thanks to folks like the others on the panel where you know, I can just straight drop like my favorite coding and you know, an agent environment spin up the CLI and suddenly my my model feels way better with very little effort, right? Like that is that is something that is already at our fingertips and it is only going to get easier and easier as as time goes on.
Comments
Sign in to comment.
Loading comments…