← All IntelClip / OtherData transparency as a trust mechanism
From Local Models: Trust, Control, Optimization — Carter Abdallah, NVIDIA · ≈10:17
“I'm happy that Nvidia continues to release data sets along with our models.”
“You can but you can go to Hugging Face you can go to Nvidia or you can go to Prime Intellect, or RC's uh HuggingFace.”
“I think that that helps to educate people on why it's much easier to trust open models than than models that we we don't get access to any of that.”
What’s in it
- Explains why releasing training datasets builds trust in AI models
- Points to where you can inspect the data behind open models
- Argues open models beat closed ones because you can verify their data
Clip transcript
word trust. >> I think too something you mentioned is like we don't get to know a lot about the data that goes into these models and that's something that I'm really happy you know that that we're trying to do which is not it's not you know the incentives don't exist for everyone to do this right so it's not something that I think is mandatory or should be mandatory thanks to the things that Lucas mentioned which is that it's rather straightforward to validate what data did go into a model without seeing the data sources originally but I'm happy that Nvidia continues to release data sets along with our models. Release environments along with our models to make sure that even even if you can't go through the work of determining what went into the model which you can do with the the weights alone for the most part you have like a spreadsheet you can look at that says here's you know a couple trillion tokens of this data set a couple trillion tokens here and I think that that helps to educate people on why it's much easier to trust open models than than models that we we don't get access to any of that. >> helps people see what that data looks like. >> Yeah. >> You know if you don't have someone releasing it openly when someone says data is going in I mean data can take many different shapes. You can but you can go to Hugging Face you can go to Nvidia or you can go to Prime Intellect, or RC's uh HuggingFace. You can look under our data sets, and you can see exactly what that looks like, um and that can help you uh inform your priors on it.
Comments
Sign in to comment.
Loading comments…