Ayush Garg

Search

Recently Updated

Rapidly scaling online storage to serve over 1 billion ChatGPT users
Sep 12, 2026
Agentic Systems
Sep 01, 2026
Write thoughtful code
Aug 28, 2026
Filesystem
Aug 20, 2026

❯

❯

Muon: An optimizer for hidden layers in neural networks

Muon: An optimizer for hidden layers in neural networks

May 11, 2026, 2 min read

Muon is an optimizer for 2D parameters of neural network hidden layers

Relevant Links

NewtonSchulz

Graph View

Backlinks

Newton-Schulz Iteration

Created by Ayush Garg using Quartz , © 2026

GitHub
Linkedin
Blog
Twitter