Altman Says Astra Ships Soon and Later Models Are Being Slowed on Purpose
- Source
- x.com
- Date
Over the summer, we have been sprinting on safety priorities; it's more important than ever for capabilities and safeguards to advance together. We have more to do but have made a lot of progress. We are also going to be launching our next model soon. There is an obvious tension here: on one hand, Astra is very good and we are excited to see what people will build with it. We are proud of our work. On the other hand, we are clearly in a phase of development where we believe caution is warranted, and we are pacing our progress to ensure that we can meet the safety standards required by new capability levels. Astra has been done training for a while now and is a significant step forward in both capabilities and alignment. For the models after that, we have been slowing things as needed to ensure that we can do sufficient work on safety and alignment. AI is getting extremely capable; no one fully understands the consequences of this. Managing the transition to a world with abundant and powerful AI to optimize for safety and benefits to people should be one of the highest priorities in the world. It is our highest priority at OpenAI. We have been living with the tension between…
Context
A model can finish training well before a company is ready to release it. In a September 1 post, Sam Altman wrote that Astra, a model OpenAI was preparing to launch, had been done training for a while and was a significant step forward in capabilities and . Altman described the summer as spent concentrating on safety priorities, and said OpenAI was pacing its progress to meet the safety standards that new capability levels require.
The post applies that pacing to later work: for the models after Astra, Altman wrote, OpenAI has been slowing things as needed to do sufficient safety and alignment work. It says the next model is coming soon but gives no date, and it offers no measurement showing that the safeguards remove the risks. What it establishes is OpenAI's own account that safety work is a pacing factor for development.
- alignment — The work of making AI systems actually pursue what their builders and users intend, rather than something subtly or dangerously different.
Checking sign-in…
Loading comments…