├── .gitignore ├── LICENSE ├── README.md ├── advanced ├── AlphaFold.xlsx ├── Autoencoder.xlsx ├── Backpropgation.xlsx ├── LSTM.xlsx ├── Mamba.xlsx ├── Multi-Layer Perceptron.xlsx ├── Multihead-Attention.xlsx ├── RNN.xlsx ├── ResNet.xlsx ├── Self-Attention.xlsx ├── Transformer-Full-Stack.xlsx ├── Transformer.xlsx └── xLSTM.xlsx ├── assets └── deepseek.png ├── basic ├── LeakyReLU.xlsx ├── Softmax.xlsx └── Temperature.xlsx ├── gallery.png ├── lectures └── DeepSeek-blank.xlsx └── workbook ├── W1_Dot-Product.xlsx ├── W2_Matrix-Multiplication.xlsx └── W3_Linear-Layer.xlsx /.gitignore: -------------------------------------------------------------------------------- 1 | 2 | .DS_Store 3 | -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- 1 | MIT License 2 | 3 | Copyright (c) 2024 Tom Yeh 4 | 5 | Permission is hereby granted, free of charge, to any person obtaining a copy 6 | of this software and associated documentation files (the "Software"), to deal 7 | in the Software without restriction, including without limitation the rights 8 | to use, copy, modify, merge, publish, distribute, sublicense, and/or sell 9 | copies of the Software, and to permit persons to whom the Software is 10 | furnished to do so, subject to the following conditions: 11 | 12 | The above copyright notice and this permission notice shall be included in all 13 | copies or substantial portions of the Software. 14 | 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR 16 | IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, 17 | FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE 18 | AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER 19 | LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, 20 | OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE 21 | SOFTWARE. 22 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # ai-by-hand-excel 2 | 3 | AI by Hand ✍️ Exercises in Excel 4 | 5 | ![](gallery.png) 6 | 7 | ## Basic 8 | * Softmax 9 | * LeakyReLU 10 | * Temperature 11 | 12 | ## Advanced 13 | * Multi Layer Perceptron (MLP) 14 | * Backpropagation 15 | * Recurrent Neural Network (RNN) 16 | * Long Short Term Memory (LSTM) (+ Seq2Seq) 17 | * Extended Long Short Term Memory (xLSTM) 18 | * Residual Network (ResNet) 19 | * Transformer - Simple 20 | * Transformer - Full Stack 21 | * Self-Attention 22 | * Multihead Attention 23 | * Autoencoder (AE) 24 | * Mamba 25 | * AlphaFold 26 | 27 | ## Lectures 28 | 29 | ### 🔥 NEW: DeepSeek 30 | Multi-head Latent Attention + Mixture of Experts 31 | (blank only) 32 | 33 | [View](https://o365coloradoedu-my.sharepoint.com/:x:/g/personal/peye9704_colorado_edu/EfAlZg6tnotMtEb3N0TA_98BWFdAiqD24mc-MqETTDoVUQ?e=dh4Ncq) 34 | | [Download](lectures/DeepSeek-blank.xlsx) 35 | ![deepseek](assets/deepseek.png) 36 | 37 | ## Workbook 38 | 1. Dot Product 39 | 2. Matrix Multiplication 40 | 3. Linear Layer 41 | 42 | ## Coming Soon 43 | * Generative Adversarial Network (GAN) 44 | * Variational Autoencoder (VAE) 45 | * U-Net 46 | * CLIP 47 | * more ... 48 | -------------------------------------------------------------------------------- /advanced/AlphaFold.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/AlphaFold.xlsx -------------------------------------------------------------------------------- /advanced/Autoencoder.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/Autoencoder.xlsx -------------------------------------------------------------------------------- /advanced/Backpropgation.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/Backpropgation.xlsx -------------------------------------------------------------------------------- /advanced/LSTM.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/LSTM.xlsx -------------------------------------------------------------------------------- /advanced/Mamba.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/Mamba.xlsx -------------------------------------------------------------------------------- /advanced/Multi-Layer Perceptron.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/Multi-Layer Perceptron.xlsx -------------------------------------------------------------------------------- /advanced/Multihead-Attention.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/Multihead-Attention.xlsx -------------------------------------------------------------------------------- /advanced/RNN.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/RNN.xlsx -------------------------------------------------------------------------------- /advanced/ResNet.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/ResNet.xlsx -------------------------------------------------------------------------------- /advanced/Self-Attention.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/Self-Attention.xlsx -------------------------------------------------------------------------------- /advanced/Transformer-Full-Stack.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/Transformer-Full-Stack.xlsx -------------------------------------------------------------------------------- /advanced/Transformer.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/Transformer.xlsx -------------------------------------------------------------------------------- /advanced/xLSTM.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/advanced/xLSTM.xlsx -------------------------------------------------------------------------------- /assets/deepseek.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/assets/deepseek.png -------------------------------------------------------------------------------- /basic/LeakyReLU.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/basic/LeakyReLU.xlsx -------------------------------------------------------------------------------- /basic/Softmax.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/basic/Softmax.xlsx -------------------------------------------------------------------------------- /basic/Temperature.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/basic/Temperature.xlsx -------------------------------------------------------------------------------- /gallery.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/gallery.png -------------------------------------------------------------------------------- /lectures/DeepSeek-blank.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/lectures/DeepSeek-blank.xlsx -------------------------------------------------------------------------------- /workbook/W1_Dot-Product.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/workbook/W1_Dot-Product.xlsx -------------------------------------------------------------------------------- /workbook/W2_Matrix-Multiplication.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/workbook/W2_Matrix-Multiplication.xlsx -------------------------------------------------------------------------------- /workbook/W3_Linear-Layer.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ImagineAILab/ai-by-hand-excel/c2529f7a2a1a239136fc3d3f01634e9b2709f27d/workbook/W3_Linear-Layer.xlsx --------------------------------------------------------------------------------