Ayush Garg

Search

SearchSearch

Recently Updated

  • SQL

    Jun 12, 2025

    • 6 Monkeys of Software Engineering

      Jun 10, 2025

      • SQLAlchemy

        Jun 08, 2025

        • NPM Dependencies & Dev Dependencies

          Jun 05, 2025

          Home

          ❯

          List of Notes

          ❯

          Attention is All You Need

          Attention is All You Need

          Apr 19, 2025, 1 min read

          Paper Link: https://arxiv.org/pdf/1706.03762

          Concepts §

          • Transformer Encoder
          • Transformer Decoder
          • Scaled Dot-Product Attention
          • Multi-Head Attention
          • Self Attention
          • Sinusoidal Positional Encoding
          • Layer Normalization

          Graph View

          Backlinks

          • Transformer Encoder
          • Transformer

          Created by Ayush Garg using Quartz , © 2025

          • GitHub
          • Linkedin
          • Blog
          • Twitter