Ayush Garg

Search

Recently Updated

Rapidly scaling online storage to serve over 1 billion ChatGPT users
Sep 12, 2026
Agentic Systems
Sep 01, 2026
Write thoughtful code
Aug 28, 2026
Filesystem
Aug 20, 2026

❯

❯

Transformer

Apr 14, 2025, 1 min read

The original transformer architecture from the Attention is All You Need paper

Graph View

Backlinks

Cohere Transformer Challenge
Pretraining
RMS Norm

Created by Ayush Garg using Quartz , © 2026

GitHub
Linkedin
Blog
Twitter