Cohere Transformer Challenge

On January 16th, 2025 I challenged Ivan Zhang (Co-Founder & CTO of Cohere) on X to a challenge

If I make a Transformer in the next 7 days give me a chance to interview at Cohere

https://x.com/ayushrgarg/status/1879619189452984652

Not only did Ivan Zhang like the post but so did Aiden Gomez (Co-Founder & CEO of Cohere)

Here are all the notes associated with this challenge showcasing what I learned

• Backpropagation
• Transformer
• Recurrent Neural Networks
• Stochastic Gradient Descent (SGD)