OpenAI's Habitat storage platform hit 20M requests/sec before its Rust rewrite

OpenAIDevs described Habitat, OpenAI's online storage platform underlying ChatGPT and Codex, saying it grew more than 10 times year over year and that its Python service handled more than 20 million requests per second at peak before a rewrite. OpenAI's longer writeup on the rewrite states that two engineers rebuilt the service in Rust, with Codex and GPT-5.5 assisting the port, and that the Rust version now serves more than 70 million requests per second across 95% of production traffic while using substantially less CPU and memory than the Python version it replaced.