Muon’s speed arguably comes from approximate orthogonalization: a few fast Newton–Schulz iterations instead of an expensive full SVD. But this makes the update inexact. So how should hyperparameters change as approximation quality varies?🧵
1/n ...
Oct 29, 2025