Why does Muon work?

I wanted to understand why the Muon optimizer works, so I went back through SGD, momentum, Adam and Shampoo and built a simulation for each idea.

November 10, 2026 · 25 min · npow