├── .gitignore ├── README.md ├── basics └── 3-gram-modeling.ipynb ├── books_reading_notes ├── LLM │ ├── 04_nlp_with_transformers.ipynb │ └── Build-A-LLM-from-Scratch │ │ ├── 2024-build-llms.pdf │ │ ├── _OceanofPDF.com_Build_a_Large_Language_Model_From_Scratch_-_Sebastian_Raschka.pdf │ │ └── chap1_understanding_LLMs.ipynb ├── RL │ ├── TD_MC_GAE.ipynb │ ├── cs285 │ │ ├── codes │ │ │ └── resources.ipynb │ │ ├── lec-15-offline-rl.ipynb │ │ ├── lec-6-actor-critic.ipynb │ │ ├── lec-7-value-function.ipynb │ │ ├── lec-8-dqn.ipynb │ │ └── roadmap_concepts.ipynb │ ├── imgs │ │ ├── grad.jpeg │ │ ├── on-off-policy.png │ │ └── sl_vs_rl.png │ └── 强化学习的数学原理.ipynb ├── deep_learning │ └── 理解深度学习-understanding-deep-learning.ipynb ├── misc │ ├── 线性代数与数据学习_learning_from_data.ipynb │ └── 计算之魂_吴军.ipynb ├── readme.md ├── 咖哥AI │ ├── 01_GPT图解.ipynb │ ├── 02_动手做_ai_agent.ipynb │ └── 03_rag_in_action.ipynb └── 深度学习入门 │ ├── 强化学习 │ ├── REINFORCE.py │ ├── chap1_bandit.ipynb │ ├── chap2_mdp.ipynb │ ├── chap3_bellman.ipynb │ ├── chap5-6_on_policy_off_policy.ipynb │ ├── chap5_monte_carlo.ipynb │ ├── chap6_TD.ipynb │ ├── chap9_policy_gradient.ipynb │ ├── chap_9_supp.ipynb │ ├── figs │ │ ├── REINFORCE.png │ │ ├── mdp-2states.png │ │ ├── pg_wss.png │ │ ├── reinforce.png │ │ ├── sl_vs_rl.png │ │ └── stochastic_tree.png │ ├── resources.ipynb │ ├── rl_highlights.ipynb │ └── utils │ │ ├── gridworld.py │ │ └── gridworld_render.py │ └── 生成模型 │ ├── data │ └── old_faithful.txt │ ├── em_gmm.ipynb │ ├── em_vae.ipynb │ └── overall.ipynb ├── from_ml_to_dl.ipynb ├── from_rnn_to_llm.ipynb ├── hightlights.ipynb ├── illustration └── 3D.ipynb ├── imgs ├── attn.png ├── cross-entropy-loss.png └── elbo.png ├── llm_通识.ipynb ├── math ├── Probability.ipynb ├── prob_formula.ipynb └── readme.md ├── nlp_foundation └── n_gram_language_models.ipynb └── pdfs ├── 5_formulas_LLMs.pdf ├── Natural_Language_Processing_with_Transformers-2022-en.pdf └── 计算之魂共读-个人学习讲义-by CELFS-20220913.pdf /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/README.md -------------------------------------------------------------------------------- /basics/3-gram-modeling.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/basics/3-gram-modeling.ipynb -------------------------------------------------------------------------------- /books_reading_notes/LLM/04_nlp_with_transformers.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/LLM/04_nlp_with_transformers.ipynb -------------------------------------------------------------------------------- /books_reading_notes/LLM/Build-A-LLM-from-Scratch/2024-build-llms.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/LLM/Build-A-LLM-from-Scratch/2024-build-llms.pdf -------------------------------------------------------------------------------- /books_reading_notes/LLM/Build-A-LLM-from-Scratch/_OceanofPDF.com_Build_a_Large_Language_Model_From_Scratch_-_Sebastian_Raschka.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/LLM/Build-A-LLM-from-Scratch/_OceanofPDF.com_Build_a_Large_Language_Model_From_Scratch_-_Sebastian_Raschka.pdf -------------------------------------------------------------------------------- /books_reading_notes/LLM/Build-A-LLM-from-Scratch/chap1_understanding_LLMs.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/LLM/Build-A-LLM-from-Scratch/chap1_understanding_LLMs.ipynb -------------------------------------------------------------------------------- /books_reading_notes/RL/TD_MC_GAE.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/TD_MC_GAE.ipynb -------------------------------------------------------------------------------- /books_reading_notes/RL/cs285/codes/resources.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/cs285/codes/resources.ipynb -------------------------------------------------------------------------------- /books_reading_notes/RL/cs285/lec-15-offline-rl.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/cs285/lec-15-offline-rl.ipynb -------------------------------------------------------------------------------- /books_reading_notes/RL/cs285/lec-6-actor-critic.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/cs285/lec-6-actor-critic.ipynb -------------------------------------------------------------------------------- /books_reading_notes/RL/cs285/lec-7-value-function.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/cs285/lec-7-value-function.ipynb -------------------------------------------------------------------------------- /books_reading_notes/RL/cs285/lec-8-dqn.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/cs285/lec-8-dqn.ipynb -------------------------------------------------------------------------------- /books_reading_notes/RL/cs285/roadmap_concepts.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/cs285/roadmap_concepts.ipynb -------------------------------------------------------------------------------- /books_reading_notes/RL/imgs/grad.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/imgs/grad.jpeg -------------------------------------------------------------------------------- /books_reading_notes/RL/imgs/on-off-policy.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/imgs/on-off-policy.png -------------------------------------------------------------------------------- /books_reading_notes/RL/imgs/sl_vs_rl.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/imgs/sl_vs_rl.png -------------------------------------------------------------------------------- /books_reading_notes/RL/强化学习的数学原理.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/RL/强化学习的数学原理.ipynb -------------------------------------------------------------------------------- /books_reading_notes/deep_learning/理解深度学习-understanding-deep-learning.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/deep_learning/理解深度学习-understanding-deep-learning.ipynb -------------------------------------------------------------------------------- /books_reading_notes/misc/线性代数与数据学习_learning_from_data.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/misc/线性代数与数据学习_learning_from_data.ipynb -------------------------------------------------------------------------------- /books_reading_notes/misc/计算之魂_吴军.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/misc/计算之魂_吴军.ipynb -------------------------------------------------------------------------------- /books_reading_notes/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/readme.md -------------------------------------------------------------------------------- /books_reading_notes/咖哥AI/01_GPT图解.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/咖哥AI/01_GPT图解.ipynb -------------------------------------------------------------------------------- /books_reading_notes/咖哥AI/02_动手做_ai_agent.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/咖哥AI/02_动手做_ai_agent.ipynb -------------------------------------------------------------------------------- /books_reading_notes/咖哥AI/03_rag_in_action.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/咖哥AI/03_rag_in_action.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/REINFORCE.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/REINFORCE.py -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/chap1_bandit.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/chap1_bandit.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/chap2_mdp.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/chap2_mdp.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/chap3_bellman.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/chap3_bellman.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/chap5-6_on_policy_off_policy.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/chap5-6_on_policy_off_policy.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/chap5_monte_carlo.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/chap5_monte_carlo.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/chap6_TD.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/chap6_TD.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/chap9_policy_gradient.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/chap9_policy_gradient.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/chap_9_supp.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/chap_9_supp.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/figs/REINFORCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/figs/REINFORCE.png -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/figs/mdp-2states.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/figs/mdp-2states.png -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/figs/pg_wss.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/figs/pg_wss.png -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/figs/reinforce.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/figs/reinforce.png -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/figs/sl_vs_rl.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/figs/sl_vs_rl.png -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/figs/stochastic_tree.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/figs/stochastic_tree.png -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/resources.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/resources.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/rl_highlights.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/rl_highlights.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/utils/gridworld.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/utils/gridworld.py -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/强化学习/utils/gridworld_render.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/强化学习/utils/gridworld_render.py -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/生成模型/data/old_faithful.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/生成模型/data/old_faithful.txt -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/生成模型/em_gmm.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/生成模型/em_gmm.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/生成模型/em_vae.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/生成模型/em_vae.ipynb -------------------------------------------------------------------------------- /books_reading_notes/深度学习入门/生成模型/overall.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/books_reading_notes/深度学习入门/生成模型/overall.ipynb -------------------------------------------------------------------------------- /from_ml_to_dl.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/from_ml_to_dl.ipynb -------------------------------------------------------------------------------- /from_rnn_to_llm.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/from_rnn_to_llm.ipynb -------------------------------------------------------------------------------- /hightlights.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/hightlights.ipynb -------------------------------------------------------------------------------- /illustration/3D.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/illustration/3D.ipynb -------------------------------------------------------------------------------- /imgs/attn.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/imgs/attn.png -------------------------------------------------------------------------------- /imgs/cross-entropy-loss.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/imgs/cross-entropy-loss.png -------------------------------------------------------------------------------- /imgs/elbo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/imgs/elbo.png -------------------------------------------------------------------------------- /llm_通识.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/llm_通识.ipynb -------------------------------------------------------------------------------- /math/Probability.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/math/Probability.ipynb -------------------------------------------------------------------------------- /math/prob_formula.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/math/prob_formula.ipynb -------------------------------------------------------------------------------- /math/readme.md: -------------------------------------------------------------------------------- 1 | 2 | ## 对概率的理解 3 | 4 | - VAE（generative models） 中的 ELBO 5 | 6 | ![ELBO](../imgs/elbo.png) -------------------------------------------------------------------------------- /nlp_foundation/n_gram_language_models.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/nlp_foundation/n_gram_language_models.ipynb -------------------------------------------------------------------------------- /pdfs/5_formulas_LLMs.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/pdfs/5_formulas_LLMs.pdf -------------------------------------------------------------------------------- /pdfs/Natural_Language_Processing_with_Transformers-2022-en.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/pdfs/Natural_Language_Processing_with_Transformers-2022-en.pdf -------------------------------------------------------------------------------- /pdfs/计算之魂共读-个人学习讲义-by CELFS-20220913.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/chunhuizhang/modern_ai_for_beginners/HEAD/pdfs/计算之魂共读-个人学习讲义-by CELFS-20220913.pdf --------------------------------------------------------------------------------