gpt

GPT From Scratch

🔗 GitHub Repository

Hi! I’m currently working on building my own GPT based on the famous paper Attention Is All You Need.

For now, this repository contains:

• Python Notebook of a decoder-only transformer following the code from Andrej Karpathy.

The goal is to ace all the suggested exercises and create a main entry point website as a central hub for information and documentation related to this project.