├── .gitignore ├── 0.引言 └── 0.ignore.md ├── 1.深度学习基础知识 ├── 1.Transformer基础.md ├── 2.深度神经网络基础.md └── images │ ├── BN.png │ └── PI.png ├── 2.自然语言处理基础知识 ├── 1.分词器(Tokenizer).md ├── 2.经典NLP模型.md ├── 3.困惑度(perplexity).md └── images │ ├── openai_token.png │ └── ppl.png ├── 3.大语言模型基础知识 ├── 1.训练框架介绍(Megatron-lm、DeepSpeed).md ├── 2.参数高效微调(PEFT).md ├── 3.经典开源LLM介绍.md ├── 4.RLHF介绍.md ├── 5.CoT、ToT介绍.md ├── 6.SFT训练.md ├── 7.混合专家模型(MOE).md └── images │ ├── MOE.png │ ├── chatglm2.png │ ├── chatglm2_optim.png │ ├── cot.png │ ├── cot_zeroshot.png │ ├── dpo.png │ ├── dpo_1.png │ ├── dpo_2.png │ ├── lora.png │ ├── lora_init.png │ ├── megatron1.png │ ├── megatron2.png │ ├── megatron3.png │ ├── megatron4.png │ ├── ptuning.png │ ├── tot.png │ └── tot_24.png ├── 4.大语言模型推理 ├── 1.Huggingface推理参数介绍.md ├── 2.KVCache.md ├── 3.LLM推理成本介绍.md └── images │ └── openai_api_price.png ├── 5.大语言模型应用 └── 1.LangChain介绍.md ├── 6.大语言模型前沿分享 ├── 1.LLM相关博客分享.md └── 2.LLM相关论文分享.md ├── LICENSE ├── Makefile ├── README.md └── tools ├── gen_readme.py ├── replace_image.py └── replace_image_revert_html_to_md.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/.gitignore -------------------------------------------------------------------------------- /0.引言/0.ignore.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/0.引言/0.ignore.md -------------------------------------------------------------------------------- /1.深度学习基础知识/1.Transformer基础.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/1.深度学习基础知识/1.Transformer基础.md -------------------------------------------------------------------------------- /1.深度学习基础知识/2.深度神经网络基础.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/1.深度学习基础知识/2.深度神经网络基础.md -------------------------------------------------------------------------------- /1.深度学习基础知识/images/BN.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/1.深度学习基础知识/images/BN.png -------------------------------------------------------------------------------- /1.深度学习基础知识/images/PI.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/1.深度学习基础知识/images/PI.png -------------------------------------------------------------------------------- /2.自然语言处理基础知识/1.分词器(Tokenizer).md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/2.自然语言处理基础知识/1.分词器(Tokenizer).md -------------------------------------------------------------------------------- /2.自然语言处理基础知识/2.经典NLP模型.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/2.自然语言处理基础知识/2.经典NLP模型.md -------------------------------------------------------------------------------- /2.自然语言处理基础知识/3.困惑度(perplexity).md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/2.自然语言处理基础知识/3.困惑度(perplexity).md -------------------------------------------------------------------------------- /2.自然语言处理基础知识/images/openai_token.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/2.自然语言处理基础知识/images/openai_token.png -------------------------------------------------------------------------------- /2.自然语言处理基础知识/images/ppl.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/2.自然语言处理基础知识/images/ppl.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/1.训练框架介绍(Megatron-lm、DeepSpeed).md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/1.训练框架介绍(Megatron-lm、DeepSpeed).md -------------------------------------------------------------------------------- /3.大语言模型基础知识/2.参数高效微调(PEFT).md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/2.参数高效微调(PEFT).md -------------------------------------------------------------------------------- /3.大语言模型基础知识/3.经典开源LLM介绍.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/3.经典开源LLM介绍.md -------------------------------------------------------------------------------- /3.大语言模型基础知识/4.RLHF介绍.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/4.RLHF介绍.md -------------------------------------------------------------------------------- /3.大语言模型基础知识/5.CoT、ToT介绍.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/5.CoT、ToT介绍.md -------------------------------------------------------------------------------- /3.大语言模型基础知识/6.SFT训练.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/6.SFT训练.md -------------------------------------------------------------------------------- /3.大语言模型基础知识/7.混合专家模型(MOE).md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/7.混合专家模型(MOE).md -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/MOE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/MOE.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/chatglm2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/chatglm2.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/chatglm2_optim.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/chatglm2_optim.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/cot.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/cot.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/cot_zeroshot.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/cot_zeroshot.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/dpo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/dpo.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/dpo_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/dpo_1.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/dpo_2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/dpo_2.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/lora.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/lora.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/lora_init.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/lora_init.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/megatron1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/megatron1.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/megatron2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/megatron2.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/megatron3.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/megatron3.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/megatron4.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/megatron4.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/ptuning.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/ptuning.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/tot.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/tot.png -------------------------------------------------------------------------------- /3.大语言模型基础知识/images/tot_24.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/3.大语言模型基础知识/images/tot_24.png -------------------------------------------------------------------------------- /4.大语言模型推理/1.Huggingface推理参数介绍.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/4.大语言模型推理/1.Huggingface推理参数介绍.md -------------------------------------------------------------------------------- /4.大语言模型推理/2.KVCache.md: -------------------------------------------------------------------------------- 1 | #### 什么是 KV Cache？ 2 | -------------------------------------------------------------------------------- /4.大语言模型推理/3.LLM推理成本介绍.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/4.大语言模型推理/3.LLM推理成本介绍.md -------------------------------------------------------------------------------- /4.大语言模型推理/images/openai_api_price.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/4.大语言模型推理/images/openai_api_price.png -------------------------------------------------------------------------------- /5.大语言模型应用/1.LangChain介绍.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/5.大语言模型应用/1.LangChain介绍.md -------------------------------------------------------------------------------- /6.大语言模型前沿分享/1.LLM相关博客分享.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/6.大语言模型前沿分享/1.LLM相关博客分享.md -------------------------------------------------------------------------------- /6.大语言模型前沿分享/2.LLM相关论文分享.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/6.大语言模型前沿分享/2.LLM相关论文分享.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/LICENSE -------------------------------------------------------------------------------- /Makefile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/Makefile -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/README.md -------------------------------------------------------------------------------- /tools/gen_readme.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/tools/gen_readme.py -------------------------------------------------------------------------------- /tools/replace_image.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/tools/replace_image.py -------------------------------------------------------------------------------- /tools/replace_image_revert_html_to_md.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kebijuelun/Awesome-LLM-Learning/HEAD/tools/replace_image_revert_html_to_md.py --------------------------------------------------------------------------------