Habitat is OpenAI's online storage platform that powers everything from ChatGPT to Codex.
It has grown over 10x year over year. Before the Rust rewrite, its Python service handled more than 20 million requests per second at peak.
The writeup covers real bottlenecks (event-loop management, connection pooling) hit scaling a storage layer to over a billion ChatGPT users, useful for anyone scaling a similar service.
