├── FAQ.md ├── FAQ_ja.md ├── FAQ_zh.md ├── LICENSE ├── NOTICE ├── QWEN_TECHNICAL_REPORT.pdf ├── README.md ├── README_CN.md ├── README_JA.md ├── README_src.md ├── assets ├── cli_demo.gif ├── code_interpreter_showcase_001.jpg ├── hfagent_chat_1.png ├── hfagent_chat_2.png ├── hfagent_run.png ├── logo.jpg ├── openai_api.gif ├── performance.png ├── qwen_tokenizer.png ├── radar_14b.jpg ├── react_showcase_001.png ├── react_showcase_002.png ├── react_tutorial_001.png ├── react_tutorial_002.png ├── tokenizer.pdf ├── tokenizer.png ├── wanx_colorful_black.png ├── web_demo.gif └── wechat.png ├── cli_demo.py ├── eval ├── EVALUATION.md ├── evaluate_ceval.py ├── evaluate_chat_ceval.py ├── evaluate_chat_gsm8k.py ├── evaluate_chat_humaneval.py ├── evaluate_chat_mmlu.py ├── evaluate_cmmlu.py ├── evaluate_gsm8k.py ├── evaluate_humaneval.py ├── evaluate_mmlu.py ├── evaluate_plugin.py └── gsm8k_prompt.txt ├── examples ├── auto_comments.md ├── auto_comments.py ├── function_call_examples.py ├── langchain_tooluse.ipynb ├── react_demo.py ├── react_prompt.md ├── tokenizer_showcase.ipynb └── transformers_agent.md ├── finetune.py ├── finetune ├── ds_config_zero2.json ├── ds_config_zero3.json ├── finetune_ds.sh ├── finetune_lora_ds.sh ├── finetune_lora_single_gpu.sh ├── finetune_qlora_ds.sh └── finetune_qlora_single_gpu.sh ├── openai_api.py ├── requirements.txt ├── requirements_web_demo.txt ├── tech_memo.md ├── tokenization_note.md ├── tokenization_note_ja.md ├── tokenization_note_zh.md ├── utils.py └── web_demo.py /FAQ.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/FAQ.md -------------------------------------------------------------------------------- /FAQ_ja.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/FAQ_ja.md -------------------------------------------------------------------------------- /FAQ_zh.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/FAQ_zh.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/LICENSE -------------------------------------------------------------------------------- /NOTICE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/NOTICE -------------------------------------------------------------------------------- /QWEN_TECHNICAL_REPORT.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/QWEN_TECHNICAL_REPORT.pdf -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/README.md -------------------------------------------------------------------------------- /README_CN.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/README_CN.md -------------------------------------------------------------------------------- /README_JA.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/README_JA.md -------------------------------------------------------------------------------- /README_src.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/README_src.md -------------------------------------------------------------------------------- /assets/cli_demo.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/cli_demo.gif -------------------------------------------------------------------------------- /assets/code_interpreter_showcase_001.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/code_interpreter_showcase_001.jpg -------------------------------------------------------------------------------- /assets/hfagent_chat_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/hfagent_chat_1.png -------------------------------------------------------------------------------- /assets/hfagent_chat_2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/hfagent_chat_2.png -------------------------------------------------------------------------------- /assets/hfagent_run.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/hfagent_run.png -------------------------------------------------------------------------------- /assets/logo.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/logo.jpg -------------------------------------------------------------------------------- /assets/openai_api.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/openai_api.gif -------------------------------------------------------------------------------- /assets/performance.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/performance.png -------------------------------------------------------------------------------- /assets/qwen_tokenizer.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/qwen_tokenizer.png -------------------------------------------------------------------------------- /assets/radar_14b.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/radar_14b.jpg -------------------------------------------------------------------------------- /assets/react_showcase_001.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/react_showcase_001.png -------------------------------------------------------------------------------- /assets/react_showcase_002.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/react_showcase_002.png -------------------------------------------------------------------------------- /assets/react_tutorial_001.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/react_tutorial_001.png -------------------------------------------------------------------------------- /assets/react_tutorial_002.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/react_tutorial_002.png -------------------------------------------------------------------------------- /assets/tokenizer.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/tokenizer.pdf -------------------------------------------------------------------------------- /assets/tokenizer.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/tokenizer.png -------------------------------------------------------------------------------- /assets/wanx_colorful_black.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/wanx_colorful_black.png -------------------------------------------------------------------------------- /assets/web_demo.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/web_demo.gif -------------------------------------------------------------------------------- /assets/wechat.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/assets/wechat.png -------------------------------------------------------------------------------- /cli_demo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/cli_demo.py -------------------------------------------------------------------------------- /eval/EVALUATION.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/EVALUATION.md -------------------------------------------------------------------------------- /eval/evaluate_ceval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/evaluate_ceval.py -------------------------------------------------------------------------------- /eval/evaluate_chat_ceval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/evaluate_chat_ceval.py -------------------------------------------------------------------------------- /eval/evaluate_chat_gsm8k.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/evaluate_chat_gsm8k.py -------------------------------------------------------------------------------- /eval/evaluate_chat_humaneval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/evaluate_chat_humaneval.py -------------------------------------------------------------------------------- /eval/evaluate_chat_mmlu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/evaluate_chat_mmlu.py -------------------------------------------------------------------------------- /eval/evaluate_cmmlu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/evaluate_cmmlu.py -------------------------------------------------------------------------------- /eval/evaluate_gsm8k.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/evaluate_gsm8k.py -------------------------------------------------------------------------------- /eval/evaluate_humaneval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/evaluate_humaneval.py -------------------------------------------------------------------------------- /eval/evaluate_mmlu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/evaluate_mmlu.py -------------------------------------------------------------------------------- /eval/evaluate_plugin.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/evaluate_plugin.py -------------------------------------------------------------------------------- /eval/gsm8k_prompt.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/eval/gsm8k_prompt.txt -------------------------------------------------------------------------------- /examples/auto_comments.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/examples/auto_comments.md -------------------------------------------------------------------------------- /examples/auto_comments.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/examples/auto_comments.py -------------------------------------------------------------------------------- /examples/function_call_examples.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/examples/function_call_examples.py -------------------------------------------------------------------------------- /examples/langchain_tooluse.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/examples/langchain_tooluse.ipynb -------------------------------------------------------------------------------- /examples/react_demo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/examples/react_demo.py -------------------------------------------------------------------------------- /examples/react_prompt.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/examples/react_prompt.md -------------------------------------------------------------------------------- /examples/tokenizer_showcase.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/examples/tokenizer_showcase.ipynb -------------------------------------------------------------------------------- /examples/transformers_agent.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/examples/transformers_agent.md -------------------------------------------------------------------------------- /finetune.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/finetune.py -------------------------------------------------------------------------------- /finetune/ds_config_zero2.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/finetune/ds_config_zero2.json -------------------------------------------------------------------------------- /finetune/ds_config_zero3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/finetune/ds_config_zero3.json -------------------------------------------------------------------------------- /finetune/finetune_ds.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/finetune/finetune_ds.sh -------------------------------------------------------------------------------- /finetune/finetune_lora_ds.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/finetune/finetune_lora_ds.sh -------------------------------------------------------------------------------- /finetune/finetune_lora_single_gpu.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/finetune/finetune_lora_single_gpu.sh -------------------------------------------------------------------------------- /finetune/finetune_qlora_ds.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/finetune/finetune_qlora_ds.sh -------------------------------------------------------------------------------- /finetune/finetune_qlora_single_gpu.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/finetune/finetune_qlora_single_gpu.sh -------------------------------------------------------------------------------- /openai_api.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/openai_api.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/requirements.txt -------------------------------------------------------------------------------- /requirements_web_demo.txt: -------------------------------------------------------------------------------- 1 | gradio 2 | mdtex2html 3 | -------------------------------------------------------------------------------- /tech_memo.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/tech_memo.md -------------------------------------------------------------------------------- /tokenization_note.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/tokenization_note.md -------------------------------------------------------------------------------- /tokenization_note_ja.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/tokenization_note_ja.md -------------------------------------------------------------------------------- /tokenization_note_zh.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/tokenization_note_zh.md -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/utils.py -------------------------------------------------------------------------------- /web_demo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ArtificialZeng/Qwen-Explained/HEAD/web_demo.py --------------------------------------------------------------------------------