├── .gitattributes ├── .gitignore ├── ARGS.md ├── AnLLM ├── config.py ├── dataset.py ├── dataset_reader.py ├── inference.py ├── model_llama.py ├── model_qwen.py ├── tokenizer.py ├── train.py └── utils.py ├── LICENSE ├── LightThinker ├── __init__.py ├── config.py ├── dataset.py ├── dataset_reader.py ├── inference.py ├── model_llama.py ├── model_qwen.py ├── tokenizer.py ├── train.py └── utils.py ├── README.md ├── assets ├── attention_mode.jpg └── gif.gif ├── configs ├── AnLLM │ ├── llama │ │ └── v1.json │ └── qwen │ │ └── v1.json ├── LightThinker │ ├── llama │ │ └── v1.json │ └── qwen │ │ └── v1.json └── ds_z3_offload_config.json ├── data └── data.zip ├── evaluation ├── constant.py ├── eval_file.py ├── init.py └── utils.py ├── inference.sh ├── inference_anllm.sh ├── requirements.txt ├── train.sh └── train_anllm.sh /.gitattributes: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/.gitattributes -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- 1 | ./model/* -------------------------------------------------------------------------------- /ARGS.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/ARGS.md -------------------------------------------------------------------------------- /AnLLM/config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/AnLLM/config.py -------------------------------------------------------------------------------- /AnLLM/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/AnLLM/dataset.py -------------------------------------------------------------------------------- /AnLLM/dataset_reader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/AnLLM/dataset_reader.py -------------------------------------------------------------------------------- /AnLLM/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/AnLLM/inference.py -------------------------------------------------------------------------------- /AnLLM/model_llama.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/AnLLM/model_llama.py -------------------------------------------------------------------------------- /AnLLM/model_qwen.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/AnLLM/model_qwen.py -------------------------------------------------------------------------------- /AnLLM/tokenizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/AnLLM/tokenizer.py -------------------------------------------------------------------------------- /AnLLM/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/AnLLM/train.py -------------------------------------------------------------------------------- /AnLLM/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/AnLLM/utils.py -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LICENSE -------------------------------------------------------------------------------- /LightThinker/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LightThinker/__init__.py -------------------------------------------------------------------------------- /LightThinker/config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LightThinker/config.py -------------------------------------------------------------------------------- /LightThinker/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LightThinker/dataset.py -------------------------------------------------------------------------------- /LightThinker/dataset_reader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LightThinker/dataset_reader.py -------------------------------------------------------------------------------- /LightThinker/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LightThinker/inference.py -------------------------------------------------------------------------------- /LightThinker/model_llama.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LightThinker/model_llama.py -------------------------------------------------------------------------------- /LightThinker/model_qwen.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LightThinker/model_qwen.py -------------------------------------------------------------------------------- /LightThinker/tokenizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LightThinker/tokenizer.py -------------------------------------------------------------------------------- /LightThinker/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LightThinker/train.py -------------------------------------------------------------------------------- /LightThinker/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/LightThinker/utils.py -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/README.md -------------------------------------------------------------------------------- /assets/attention_mode.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/assets/attention_mode.jpg -------------------------------------------------------------------------------- /assets/gif.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/assets/gif.gif -------------------------------------------------------------------------------- /configs/AnLLM/llama/v1.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/configs/AnLLM/llama/v1.json -------------------------------------------------------------------------------- /configs/AnLLM/qwen/v1.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/configs/AnLLM/qwen/v1.json -------------------------------------------------------------------------------- /configs/LightThinker/llama/v1.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/configs/LightThinker/llama/v1.json -------------------------------------------------------------------------------- /configs/LightThinker/qwen/v1.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/configs/LightThinker/qwen/v1.json -------------------------------------------------------------------------------- /configs/ds_z3_offload_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/configs/ds_z3_offload_config.json -------------------------------------------------------------------------------- /data/data.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/data/data.zip -------------------------------------------------------------------------------- /evaluation/constant.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/evaluation/constant.py -------------------------------------------------------------------------------- /evaluation/eval_file.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/evaluation/eval_file.py -------------------------------------------------------------------------------- /evaluation/init.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/evaluation/init.py -------------------------------------------------------------------------------- /evaluation/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/evaluation/utils.py -------------------------------------------------------------------------------- /inference.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/inference.sh -------------------------------------------------------------------------------- /inference_anllm.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/inference_anllm.sh -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/requirements.txt -------------------------------------------------------------------------------- /train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/train.sh -------------------------------------------------------------------------------- /train_anllm.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/LightThinker/HEAD/train_anllm.sh --------------------------------------------------------------------------------