├── Exercises ├── makemore exercises │ ├── part1_bigrams._exercises.ipynb │ ├── part2_MLP_exercises.ipynb │ ├── part3_bn_exercises.ipynb │ └── part5_wavenet_exercices.ipynb ├── micrograd exercises │ └── micrograd_exercises.ipynb └── nanoGPT exercises │ └── part6_nano_gpt_exercises.ipynb ├── GPT2 ├── 1_1_define_arch.ipynb ├── 1_2_dataloader_and_init.ipynb ├── 2_optimization.ipynb ├── 3_1_hparams.ipynb ├── 3_2_DDP.ipynb ├── DDP.py └── README.md ├── README.md ├── data ├── input.txt └── names.txt ├── images ├── MLP.png ├── cover.jpg ├── cover_GPT2.png ├── diagram.png ├── dilated_casual_conv.png └── gpt_tokenizer.png ├── makemore ├── part1_bigrams.ipynb ├── part2_MLP.ipynb ├── part3_bn.ipynb ├── part4_backprop.ipynb └── part5_wavenet.ipynb ├── micrograd └── 1.micrograd.ipynb ├── minBPE └── Tokenization.ipynb └── nanoGPT ├── bigram.py └── part6_nano_gpt.ipynb /Exercises/makemore exercises/part1_bigrams._exercises.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/Exercises/makemore exercises/part1_bigrams._exercises.ipynb -------------------------------------------------------------------------------- /Exercises/makemore exercises/part2_MLP_exercises.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/Exercises/makemore exercises/part2_MLP_exercises.ipynb -------------------------------------------------------------------------------- /Exercises/makemore exercises/part3_bn_exercises.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/Exercises/makemore exercises/part3_bn_exercises.ipynb -------------------------------------------------------------------------------- /Exercises/makemore exercises/part5_wavenet_exercices.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/Exercises/makemore exercises/part5_wavenet_exercices.ipynb -------------------------------------------------------------------------------- /Exercises/micrograd exercises/micrograd_exercises.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/Exercises/micrograd exercises/micrograd_exercises.ipynb -------------------------------------------------------------------------------- /Exercises/nanoGPT exercises/part6_nano_gpt_exercises.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/Exercises/nanoGPT exercises/part6_nano_gpt_exercises.ipynb -------------------------------------------------------------------------------- /GPT2/1_1_define_arch.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/GPT2/1_1_define_arch.ipynb -------------------------------------------------------------------------------- /GPT2/1_2_dataloader_and_init.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/GPT2/1_2_dataloader_and_init.ipynb -------------------------------------------------------------------------------- /GPT2/2_optimization.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/GPT2/2_optimization.ipynb -------------------------------------------------------------------------------- /GPT2/3_1_hparams.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/GPT2/3_1_hparams.ipynb -------------------------------------------------------------------------------- /GPT2/3_2_DDP.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/GPT2/3_2_DDP.ipynb -------------------------------------------------------------------------------- /GPT2/DDP.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/GPT2/DDP.py -------------------------------------------------------------------------------- /GPT2/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/GPT2/README.md -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/README.md -------------------------------------------------------------------------------- /data/input.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/data/input.txt -------------------------------------------------------------------------------- /data/names.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/data/names.txt -------------------------------------------------------------------------------- /images/MLP.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/images/MLP.png -------------------------------------------------------------------------------- /images/cover.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/images/cover.jpg -------------------------------------------------------------------------------- /images/cover_GPT2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/images/cover_GPT2.png -------------------------------------------------------------------------------- /images/diagram.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/images/diagram.png -------------------------------------------------------------------------------- /images/dilated_casual_conv.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/images/dilated_casual_conv.png -------------------------------------------------------------------------------- /images/gpt_tokenizer.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/images/gpt_tokenizer.png -------------------------------------------------------------------------------- /makemore/part1_bigrams.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/makemore/part1_bigrams.ipynb -------------------------------------------------------------------------------- /makemore/part2_MLP.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/makemore/part2_MLP.ipynb -------------------------------------------------------------------------------- /makemore/part3_bn.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/makemore/part3_bn.ipynb -------------------------------------------------------------------------------- /makemore/part4_backprop.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/makemore/part4_backprop.ipynb -------------------------------------------------------------------------------- /makemore/part5_wavenet.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/makemore/part5_wavenet.ipynb -------------------------------------------------------------------------------- /micrograd/1.micrograd.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/micrograd/1.micrograd.ipynb -------------------------------------------------------------------------------- /minBPE/Tokenization.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/minBPE/Tokenization.ipynb -------------------------------------------------------------------------------- /nanoGPT/bigram.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/nanoGPT/bigram.py -------------------------------------------------------------------------------- /nanoGPT/part6_nano_gpt.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/0ssamaak0/Karpathy-Neural-Networks-Zero-to-Hero/HEAD/nanoGPT/part6_nano_gpt.ipynb --------------------------------------------------------------------------------