├── 01_NGram_BoW ├── BiGram.ipynb └── BoW.ipynb ├── 02_Word2Vec ├── CBOW.ipynb ├── SkipGram-Enbedding.ipynb └── SkipGram.ipynb ├── 03_NPLM ├── NPLM.ipynb └── RNN.ipynb ├── 04_Seq2Seq └── Seq2Seq.ipynb ├── 05_Attention ├── Dot-Product_Attention.ipynb ├── Multiheads-Self-Attention.ipynb ├── QKV.ipynb ├── Scaled_Dot-Product_Attention.ipynb ├── Self-Attention.ipynb └── Seq2Seq_with_Attention.ipynb ├── 06_Transformer └── Transformer.ipynb ├── 07_GPT ├── GPT.ipynb ├── Transformer_with_GreedyDecoder.ipynb ├── WikiGPT.ipynb └── lang.txt ├── 08_ChatGPT ├── .ipynb_checkpoints │ └── SelfTrain_ChatGPT-checkpoint.ipynb ├── GPT_Model.py ├── Pretrain_ChatGPT.ipynb ├── RLHF_Reward_ChatGPT.py ├── SelfTrain_ChatGPT.ipynb └── chat.txt ├── 09_OpenAI_API ├── ChatBot.ipynb └── ChatBot.py ├── README.md ├── images ├── Archive │ ├── 8daf31eae3eb392efbb4624feb3c53d.jpg │ ├── c41f10da370ac2ff5a3dcd63a55db06.jpg │ └── e4f961d4b53cd9f956d26784e39daa7.jpg ├── P109.png ├── book.png └── sales.png └── 勘误表.md /01_NGram_BoW/BiGram.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/01_NGram_BoW/BiGram.ipynb -------------------------------------------------------------------------------- /01_NGram_BoW/BoW.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/01_NGram_BoW/BoW.ipynb -------------------------------------------------------------------------------- /02_Word2Vec/CBOW.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/02_Word2Vec/CBOW.ipynb -------------------------------------------------------------------------------- /02_Word2Vec/SkipGram-Enbedding.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/02_Word2Vec/SkipGram-Enbedding.ipynb -------------------------------------------------------------------------------- /02_Word2Vec/SkipGram.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/02_Word2Vec/SkipGram.ipynb -------------------------------------------------------------------------------- /03_NPLM/NPLM.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/03_NPLM/NPLM.ipynb -------------------------------------------------------------------------------- /03_NPLM/RNN.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/03_NPLM/RNN.ipynb -------------------------------------------------------------------------------- /04_Seq2Seq/Seq2Seq.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/04_Seq2Seq/Seq2Seq.ipynb -------------------------------------------------------------------------------- /05_Attention/Dot-Product_Attention.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/05_Attention/Dot-Product_Attention.ipynb -------------------------------------------------------------------------------- /05_Attention/Multiheads-Self-Attention.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/05_Attention/Multiheads-Self-Attention.ipynb -------------------------------------------------------------------------------- /05_Attention/QKV.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/05_Attention/QKV.ipynb -------------------------------------------------------------------------------- /05_Attention/Scaled_Dot-Product_Attention.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/05_Attention/Scaled_Dot-Product_Attention.ipynb -------------------------------------------------------------------------------- /05_Attention/Self-Attention.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/05_Attention/Self-Attention.ipynb -------------------------------------------------------------------------------- /05_Attention/Seq2Seq_with_Attention.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/05_Attention/Seq2Seq_with_Attention.ipynb -------------------------------------------------------------------------------- /06_Transformer/Transformer.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/06_Transformer/Transformer.ipynb -------------------------------------------------------------------------------- /07_GPT/GPT.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/07_GPT/GPT.ipynb -------------------------------------------------------------------------------- /07_GPT/Transformer_with_GreedyDecoder.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/07_GPT/Transformer_with_GreedyDecoder.ipynb -------------------------------------------------------------------------------- /07_GPT/WikiGPT.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/07_GPT/WikiGPT.ipynb -------------------------------------------------------------------------------- /07_GPT/lang.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/07_GPT/lang.txt -------------------------------------------------------------------------------- /08_ChatGPT/.ipynb_checkpoints/SelfTrain_ChatGPT-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/08_ChatGPT/.ipynb_checkpoints/SelfTrain_ChatGPT-checkpoint.ipynb -------------------------------------------------------------------------------- /08_ChatGPT/GPT_Model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/08_ChatGPT/GPT_Model.py -------------------------------------------------------------------------------- /08_ChatGPT/Pretrain_ChatGPT.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/08_ChatGPT/Pretrain_ChatGPT.ipynb -------------------------------------------------------------------------------- /08_ChatGPT/RLHF_Reward_ChatGPT.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/08_ChatGPT/RLHF_Reward_ChatGPT.py -------------------------------------------------------------------------------- /08_ChatGPT/SelfTrain_ChatGPT.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/08_ChatGPT/SelfTrain_ChatGPT.ipynb -------------------------------------------------------------------------------- /08_ChatGPT/chat.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/08_ChatGPT/chat.txt -------------------------------------------------------------------------------- /09_OpenAI_API/ChatBot.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/09_OpenAI_API/ChatBot.ipynb -------------------------------------------------------------------------------- /09_OpenAI_API/ChatBot.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/09_OpenAI_API/ChatBot.py -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/README.md -------------------------------------------------------------------------------- /images/Archive/8daf31eae3eb392efbb4624feb3c53d.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/images/Archive/8daf31eae3eb392efbb4624feb3c53d.jpg -------------------------------------------------------------------------------- /images/Archive/c41f10da370ac2ff5a3dcd63a55db06.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/images/Archive/c41f10da370ac2ff5a3dcd63a55db06.jpg -------------------------------------------------------------------------------- /images/Archive/e4f961d4b53cd9f956d26784e39daa7.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/images/Archive/e4f961d4b53cd9f956d26784e39daa7.jpg -------------------------------------------------------------------------------- /images/P109.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/images/P109.png -------------------------------------------------------------------------------- /images/book.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/images/book.png -------------------------------------------------------------------------------- /images/sales.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/images/sales.png -------------------------------------------------------------------------------- /勘误表.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huangjia2019/llm-gpt/HEAD/勘误表.md --------------------------------------------------------------------------------