GPT-5.4 Pro is an incredible visual reasoner. Solved this maze in 35 mins. Third image is a failed attempt at a similar maze by GPT-5.1 Pro in Nov. '25. AI progress is rapid.

A GPT-5.4 rumor was that the model can persist state. Jeff Dean mentioned this on his @latentspacepod appearance, so clearly something the AI Labs are thinking about. I'd bet there's a good chance they've discovered how to effectively integrate State-Space Models with Transformers at scale. SSMs are designed to carry a hidden state forward with every computational step, and scale linearly rather than quadratically like Transformers. Also backs up the rumor that GPT-5.4 will have a 2 million token context window. Persistent state would essentially mean that AI models go from being Guy Pearce's character in "Memento" to Dustin Hoffman's character in "Rain Man" overnight. It would give AI models true long-term memory. It would be a massive breakthrough for real.

GPT-5.4 is coming. Hints are out there for those with eyes to see. Greg Brockman told Rick Rubin: "A physicist used our un-released model to autonomously disprove a hypothesis in Quantum Physics." The physicist said it was the first time he felt the model could "think".