├── README.md ├── comparison.py ├── dataset ├── AQuA │ └── test.json ├── AddSub │ └── AddSub.json ├── Bigbench_Date │ └── task.json ├── Bigbench_object_tracking │ └── task.json ├── CommonsenseQA │ ├── dev_rand_split.jsonl │ ├── test_rand_split_no_answers.jsonl │ └── train_rand_split.jsonl ├── MultiArith │ └── MultiArith.json ├── SVAMP │ └── SVAMP.json ├── SingleEq │ └── questions.json ├── StrategyQA │ └── task.json ├── coin_flip │ └── coin_flip.json ├── grade-school-math │ └── test.jsonl └── last_letters │ └── last_letters.json ├── img ├── compa.png ├── fra-st-cot.png ├── framework.png └── sample_num.png ├── main.py ├── requirements.txt ├── testing_log ├── Zero-CoT-SC3+Our_AQUA.log ├── Zero-CoT-SC3+Our_multiarith.log └── Zero-CoT-SC7+Our_AQUA.log └── utils.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/README.md -------------------------------------------------------------------------------- /comparison.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/comparison.py -------------------------------------------------------------------------------- /dataset/AQuA/test.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/AQuA/test.json -------------------------------------------------------------------------------- /dataset/AddSub/AddSub.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/AddSub/AddSub.json -------------------------------------------------------------------------------- /dataset/Bigbench_Date/task.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/Bigbench_Date/task.json -------------------------------------------------------------------------------- /dataset/Bigbench_object_tracking/task.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/Bigbench_object_tracking/task.json -------------------------------------------------------------------------------- /dataset/CommonsenseQA/dev_rand_split.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/CommonsenseQA/dev_rand_split.jsonl -------------------------------------------------------------------------------- /dataset/CommonsenseQA/test_rand_split_no_answers.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/CommonsenseQA/test_rand_split_no_answers.jsonl -------------------------------------------------------------------------------- /dataset/CommonsenseQA/train_rand_split.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/CommonsenseQA/train_rand_split.jsonl -------------------------------------------------------------------------------- /dataset/MultiArith/MultiArith.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/MultiArith/MultiArith.json -------------------------------------------------------------------------------- /dataset/SVAMP/SVAMP.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/SVAMP/SVAMP.json -------------------------------------------------------------------------------- /dataset/SingleEq/questions.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/SingleEq/questions.json -------------------------------------------------------------------------------- /dataset/StrategyQA/task.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/StrategyQA/task.json -------------------------------------------------------------------------------- /dataset/coin_flip/coin_flip.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/coin_flip/coin_flip.json -------------------------------------------------------------------------------- /dataset/grade-school-math/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/grade-school-math/test.jsonl -------------------------------------------------------------------------------- /dataset/last_letters/last_letters.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/dataset/last_letters/last_letters.json -------------------------------------------------------------------------------- /img/compa.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/img/compa.png -------------------------------------------------------------------------------- /img/fra-st-cot.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/img/fra-st-cot.png -------------------------------------------------------------------------------- /img/framework.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/img/framework.png -------------------------------------------------------------------------------- /img/sample_num.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/img/sample_num.png -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/main.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | openai==0.18.0 2 | -------------------------------------------------------------------------------- /testing_log/Zero-CoT-SC3+Our_AQUA.log: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/testing_log/Zero-CoT-SC3+Our_AQUA.log -------------------------------------------------------------------------------- /testing_log/Zero-CoT-SC3+Our_multiarith.log: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/testing_log/Zero-CoT-SC3+Our_multiarith.log -------------------------------------------------------------------------------- /testing_log/Zero-CoT-SC7+Our_AQUA.log: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/testing_log/Zero-CoT-SC7+Our_AQUA.log -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zongqianwu/ST-COT/HEAD/utils.py --------------------------------------------------------------------------------