Ayush Garg

Search

SearchSearch

Recently Updated

  • Hi, I am Ayush 1️⃣9️⃣

    Jan 31, 2026

    • Flash Attention

      Jan 31, 2026

      • Hyperic

        Jan 31, 2026

        • Obsidian

          Jan 31, 2026

          Home

          ❯

          List of Notes

          ❯

          Attention is All You Need

          Attention is All You Need

          Apr 19, 2025, 1 min read

          Paper Link: https://arxiv.org/pdf/1706.03762

          Concepts §

          • Transformer Encoder
          • Transformer Decoder
          • Scaled Dot-Product Attention
          • Multi-Head Attention
          • Self Attention
          • Sinusoidal Positional Encoding
          • Layer Normalization

          Graph View

          Backlinks

          • Transformer Encoder
          • Transformer

          Created by Ayush Garg using Quartz , © 2026

          • GitHub
          • Linkedin
          • Blog
          • Twitter