Ayush Garg

Search

Recently Updated

Exponential Moving Average
Jul 30, 2026
Revisiting Feature Prediction for Learning Visual Representations from Video
Jul 30, 2026
- #research-paper
Stop Gradient
Jul 30, 2026
Clash Royale Agent
Jul 22, 2026

❯

❯

Muon: An optimizer for hidden layers in neural networks

Muon: An optimizer for hidden layers in neural networks

May 11, 2026, 2 min read

Muon is an optimizer for 2D parameters of neural network hidden layers

Relevant Links

NewtonSchulz

Graph View

Backlinks

Newton-Schulz Iteration

Created by Ayush Garg using Quartz , © 2026

GitHub
Linkedin
Blog
Twitter