├── README.md ├── api.py ├── dataset └── 111.txt ├── demo ├── coin_flip_1 ├── coin_flip_2 ├── coin_flip_3 ├── coin_flip_4 ├── coin_flip_6 ├── coin_flip_false ├── gsm8k ├── gsm8k_1 ├── gsm8k_2 ├── gsm8k_3 ├── last_letters_1 ├── last_letters_10 ├── last_letters_2 ├── last_letters_3 ├── last_letters_4 ├── last_letters_5 ├── last_letters_6 ├── last_letters_false ├── singleeq_1 ├── singleeq_10 ├── singleeq_2 ├── singleeq_3 ├── singleeq_4 ├── strategyqa_1 ├── strategyqa_10 ├── strategyqa_2 ├── strategyqa_3 ├── strategyqa_6 ├── strategyqa_false ├── svamp_1 ├── svamp_10 └── svamp_2 ├── experiment └── 111.txt ├── intro.pdf ├── intro.png ├── output.txt ├── result └── result.txt ├── run_inference.py ├── try_cot.ipynb ├── try_cot_colab.ipynb └── utils.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/README.md -------------------------------------------------------------------------------- /api.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/api.py -------------------------------------------------------------------------------- /dataset/111.txt: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /demo/coin_flip_1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/coin_flip_1 -------------------------------------------------------------------------------- /demo/coin_flip_2: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/coin_flip_2 -------------------------------------------------------------------------------- /demo/coin_flip_3: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/coin_flip_3 -------------------------------------------------------------------------------- /demo/coin_flip_4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/coin_flip_4 -------------------------------------------------------------------------------- /demo/coin_flip_6: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/coin_flip_6 -------------------------------------------------------------------------------- /demo/coin_flip_false: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/coin_flip_false -------------------------------------------------------------------------------- /demo/gsm8k: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/gsm8k -------------------------------------------------------------------------------- /demo/gsm8k_1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/gsm8k_1 -------------------------------------------------------------------------------- /demo/gsm8k_2: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/gsm8k_2 -------------------------------------------------------------------------------- /demo/gsm8k_3: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/gsm8k_3 -------------------------------------------------------------------------------- /demo/last_letters_1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/last_letters_1 -------------------------------------------------------------------------------- /demo/last_letters_10: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/last_letters_10 -------------------------------------------------------------------------------- /demo/last_letters_2: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/last_letters_2 -------------------------------------------------------------------------------- /demo/last_letters_3: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/last_letters_3 -------------------------------------------------------------------------------- /demo/last_letters_4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/last_letters_4 -------------------------------------------------------------------------------- /demo/last_letters_5: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/last_letters_5 -------------------------------------------------------------------------------- /demo/last_letters_6: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/last_letters_6 -------------------------------------------------------------------------------- /demo/last_letters_false: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/last_letters_false -------------------------------------------------------------------------------- /demo/singleeq_1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/singleeq_1 -------------------------------------------------------------------------------- /demo/singleeq_10: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/singleeq_10 -------------------------------------------------------------------------------- /demo/singleeq_2: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/singleeq_2 -------------------------------------------------------------------------------- /demo/singleeq_3: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/singleeq_3 -------------------------------------------------------------------------------- /demo/singleeq_4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/singleeq_4 -------------------------------------------------------------------------------- /demo/strategyqa_1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/strategyqa_1 -------------------------------------------------------------------------------- /demo/strategyqa_10: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/strategyqa_10 -------------------------------------------------------------------------------- /demo/strategyqa_2: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/strategyqa_2 -------------------------------------------------------------------------------- /demo/strategyqa_3: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/strategyqa_3 -------------------------------------------------------------------------------- /demo/strategyqa_6: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/strategyqa_6 -------------------------------------------------------------------------------- /demo/strategyqa_false: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/strategyqa_false -------------------------------------------------------------------------------- /demo/svamp_1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/svamp_1 -------------------------------------------------------------------------------- /demo/svamp_10: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/svamp_10 -------------------------------------------------------------------------------- /demo/svamp_2: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/demo/svamp_2 -------------------------------------------------------------------------------- /experiment/111.txt: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /intro.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/intro.pdf -------------------------------------------------------------------------------- /intro.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/intro.png -------------------------------------------------------------------------------- /output.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/output.txt -------------------------------------------------------------------------------- /result/result.txt: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /run_inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/run_inference.py -------------------------------------------------------------------------------- /try_cot.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/try_cot.ipynb -------------------------------------------------------------------------------- /try_cot_colab.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/try_cot_colab.ipynb -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MingyuJ666/The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models/HEAD/utils.py --------------------------------------------------------------------------------