Ayush Garg

Search

SearchSearch

Recently Updated

  • LoRA: Low Rank Adaptation of Large Language Models

    Sep 16, 2025

    • University of Waterloo

      Sep 11, 2025

      • #university-of-waterloo
    • A Vision-Language-Action Flow Model for General Robot Control

      Sep 11, 2025

      • #research-paper
    • CS 241 - Definitions

      Sep 09, 2025

      Home

      ❯

      List of Notes

      ❯

      Attention is All You Need

      Attention is All You Need

      Apr 19, 2025, 1 min read

      Paper Link: https://arxiv.org/pdf/1706.03762

      Concepts §

      • Transformer Encoder
      • Transformer Decoder
      • Scaled Dot-Product Attention
      • Multi-Head Attention
      • Self Attention
      • Sinusoidal Positional Encoding
      • Layer Normalization

      Graph View

      Backlinks

      • Transformer Encoder
      • Transformer

      Created by Ayush Garg using Quartz , © 2025

      • GitHub
      • Linkedin
      • Blog
      • Twitter