├── .gitignore ├── LICENSE ├── PromptCoT_1.0 ├── README.md ├── calc_acc.py ├── concept_encoding.py ├── concept_sampling.py ├── configs │ ├── promptcot_ds_1_5b_config.json │ ├── promptcot_ds_7b_config.json │ └── promptcot_qwq_32b_config.json ├── data │ ├── aime2024.jsonl │ ├── aime2025.jsonl │ ├── gsm8k.jsonl │ ├── math500.jsonl │ ├── mathematics_concepts.jsonl │ └── qwq │ │ ├── qwq_aime2024_test.jsonl │ │ ├── qwq_aime2025_test.jsonl │ │ ├── qwq_gsm8k_test.jsonl │ │ └── qwq_math500_test.jsonl ├── data_synthesis.py ├── eval │ ├── math_equivalence.py │ ├── qwen_math.py │ └── util.py ├── infer_longcot.py ├── problem_filtering.py ├── problem_generation.py ├── rejection_sampling_reward.py ├── requirements.txt └── train.py ├── PromptCoT_Mamba ├── README.md ├── calc_acc_aime.py ├── calc_acc_lcb.py ├── configs │ └── promptcot_mamba_7b_config.json ├── data │ ├── aime_test.jsonl │ └── livecodebench_test.jsonl ├── infer_longcot.py ├── livecodebench_v5.py ├── livecodebench_v5_utils │ ├── compute_code_generation_metrics.py │ ├── pass_k_utils.py │ ├── process_data.py │ └── testing_util.py ├── math_opensource_utils │ ├── math_equivalence.py │ ├── qwen_math.py │ └── util.py ├── requirements.txt └── train.py ├── README.md ├── assets ├── 2ec3a1b84d730fa20c30e9f8079860a3.png ├── 87abc8046464863cfd1149fc94e47747.png ├── d54677c190135988a485751bb8ebb268.png └── logo.png ├── data ├── promptcot2_aime24_test.jsonl ├── promptcot2_aime25_test.jsonl ├── promptcot2_codeforces_test.jsonl ├── promptcot2_hmmt25_test.jsonl ├── promptcot2_lcb_v5_test.jsonl └── promptcot2_lcb_v6_test.jsonl ├── deduplicate_problems.py ├── eval └── qwen_math.py ├── infer_self_play.py ├── infer_split_merge.py ├── livecodebench_v5_utils ├── compute_code_generation_metrics.py ├── pass_k_utils.py ├── process_data.py └── testing_util.py ├── prepare_self_play_data.py ├── prepare_sft_data_code.py ├── problem_generation.sh ├── requirements.txt ├── self_play_eval.py ├── test_cases_generation.py ├── test_cases_postprocess.py └── utils.py /.gitignore: -------------------------------------------------------------------------------- 1 | .DS_Store 2 | -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/LICENSE -------------------------------------------------------------------------------- /PromptCoT_1.0/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/README.md -------------------------------------------------------------------------------- /PromptCoT_1.0/calc_acc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/calc_acc.py -------------------------------------------------------------------------------- /PromptCoT_1.0/concept_encoding.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/concept_encoding.py -------------------------------------------------------------------------------- /PromptCoT_1.0/concept_sampling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/concept_sampling.py -------------------------------------------------------------------------------- /PromptCoT_1.0/configs/promptcot_ds_1_5b_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/configs/promptcot_ds_1_5b_config.json -------------------------------------------------------------------------------- /PromptCoT_1.0/configs/promptcot_ds_7b_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/configs/promptcot_ds_7b_config.json -------------------------------------------------------------------------------- /PromptCoT_1.0/configs/promptcot_qwq_32b_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/configs/promptcot_qwq_32b_config.json -------------------------------------------------------------------------------- /PromptCoT_1.0/data/aime2024.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/data/aime2024.jsonl -------------------------------------------------------------------------------- /PromptCoT_1.0/data/aime2025.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/data/aime2025.jsonl -------------------------------------------------------------------------------- /PromptCoT_1.0/data/gsm8k.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/data/gsm8k.jsonl -------------------------------------------------------------------------------- /PromptCoT_1.0/data/math500.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/data/math500.jsonl -------------------------------------------------------------------------------- /PromptCoT_1.0/data/mathematics_concepts.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/data/mathematics_concepts.jsonl -------------------------------------------------------------------------------- /PromptCoT_1.0/data/qwq/qwq_aime2024_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/data/qwq/qwq_aime2024_test.jsonl -------------------------------------------------------------------------------- /PromptCoT_1.0/data/qwq/qwq_aime2025_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/data/qwq/qwq_aime2025_test.jsonl -------------------------------------------------------------------------------- /PromptCoT_1.0/data/qwq/qwq_gsm8k_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/data/qwq/qwq_gsm8k_test.jsonl -------------------------------------------------------------------------------- /PromptCoT_1.0/data/qwq/qwq_math500_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/data/qwq/qwq_math500_test.jsonl -------------------------------------------------------------------------------- /PromptCoT_1.0/data_synthesis.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/data_synthesis.py -------------------------------------------------------------------------------- /PromptCoT_1.0/eval/math_equivalence.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/eval/math_equivalence.py -------------------------------------------------------------------------------- /PromptCoT_1.0/eval/qwen_math.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/eval/qwen_math.py -------------------------------------------------------------------------------- /PromptCoT_1.0/eval/util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/eval/util.py -------------------------------------------------------------------------------- /PromptCoT_1.0/infer_longcot.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/infer_longcot.py -------------------------------------------------------------------------------- /PromptCoT_1.0/problem_filtering.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/problem_filtering.py -------------------------------------------------------------------------------- /PromptCoT_1.0/problem_generation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/problem_generation.py -------------------------------------------------------------------------------- /PromptCoT_1.0/rejection_sampling_reward.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/rejection_sampling_reward.py -------------------------------------------------------------------------------- /PromptCoT_1.0/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/requirements.txt -------------------------------------------------------------------------------- /PromptCoT_1.0/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_1.0/train.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/README.md -------------------------------------------------------------------------------- /PromptCoT_Mamba/calc_acc_aime.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/calc_acc_aime.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/calc_acc_lcb.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/calc_acc_lcb.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/configs/promptcot_mamba_7b_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/configs/promptcot_mamba_7b_config.json -------------------------------------------------------------------------------- /PromptCoT_Mamba/data/aime_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/data/aime_test.jsonl -------------------------------------------------------------------------------- /PromptCoT_Mamba/data/livecodebench_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/data/livecodebench_test.jsonl -------------------------------------------------------------------------------- /PromptCoT_Mamba/infer_longcot.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/infer_longcot.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/livecodebench_v5.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/livecodebench_v5.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/livecodebench_v5_utils/compute_code_generation_metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/livecodebench_v5_utils/compute_code_generation_metrics.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/livecodebench_v5_utils/pass_k_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/livecodebench_v5_utils/pass_k_utils.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/livecodebench_v5_utils/process_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/livecodebench_v5_utils/process_data.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/livecodebench_v5_utils/testing_util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/livecodebench_v5_utils/testing_util.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/math_opensource_utils/math_equivalence.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/math_opensource_utils/math_equivalence.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/math_opensource_utils/qwen_math.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/math_opensource_utils/qwen_math.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/math_opensource_utils/util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/math_opensource_utils/util.py -------------------------------------------------------------------------------- /PromptCoT_Mamba/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/requirements.txt -------------------------------------------------------------------------------- /PromptCoT_Mamba/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/PromptCoT_Mamba/train.py -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/README.md -------------------------------------------------------------------------------- /assets/2ec3a1b84d730fa20c30e9f8079860a3.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/assets/2ec3a1b84d730fa20c30e9f8079860a3.png -------------------------------------------------------------------------------- /assets/87abc8046464863cfd1149fc94e47747.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/assets/87abc8046464863cfd1149fc94e47747.png -------------------------------------------------------------------------------- /assets/d54677c190135988a485751bb8ebb268.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/assets/d54677c190135988a485751bb8ebb268.png -------------------------------------------------------------------------------- /assets/logo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/assets/logo.png -------------------------------------------------------------------------------- /data/promptcot2_aime24_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/data/promptcot2_aime24_test.jsonl -------------------------------------------------------------------------------- /data/promptcot2_aime25_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/data/promptcot2_aime25_test.jsonl -------------------------------------------------------------------------------- /data/promptcot2_codeforces_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/data/promptcot2_codeforces_test.jsonl -------------------------------------------------------------------------------- /data/promptcot2_hmmt25_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/data/promptcot2_hmmt25_test.jsonl -------------------------------------------------------------------------------- /data/promptcot2_lcb_v5_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/data/promptcot2_lcb_v5_test.jsonl -------------------------------------------------------------------------------- /data/promptcot2_lcb_v6_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/data/promptcot2_lcb_v6_test.jsonl -------------------------------------------------------------------------------- /deduplicate_problems.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/deduplicate_problems.py -------------------------------------------------------------------------------- /eval/qwen_math.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/eval/qwen_math.py -------------------------------------------------------------------------------- /infer_self_play.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/infer_self_play.py -------------------------------------------------------------------------------- /infer_split_merge.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/infer_split_merge.py -------------------------------------------------------------------------------- /livecodebench_v5_utils/compute_code_generation_metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/livecodebench_v5_utils/compute_code_generation_metrics.py -------------------------------------------------------------------------------- /livecodebench_v5_utils/pass_k_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/livecodebench_v5_utils/pass_k_utils.py -------------------------------------------------------------------------------- /livecodebench_v5_utils/process_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/livecodebench_v5_utils/process_data.py -------------------------------------------------------------------------------- /livecodebench_v5_utils/testing_util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/livecodebench_v5_utils/testing_util.py -------------------------------------------------------------------------------- /prepare_self_play_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/prepare_self_play_data.py -------------------------------------------------------------------------------- /prepare_sft_data_code.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/prepare_sft_data_code.py -------------------------------------------------------------------------------- /problem_generation.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/problem_generation.sh -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/requirements.txt -------------------------------------------------------------------------------- /self_play_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/self_play_eval.py -------------------------------------------------------------------------------- /test_cases_generation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/test_cases_generation.py -------------------------------------------------------------------------------- /test_cases_postprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/test_cases_postprocess.py -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/inclusionAI/PromptCoT/HEAD/utils.py --------------------------------------------------------------------------------