├── .gitignore ├── LICENSE ├── README.md ├── config ├── dimension_definition.json ├── dimension_set.json ├── first2second_mapping.json ├── mathusereval.json ├── multi-dimension.json ├── subcategory_question_mapping.json └── temperature.json ├── data ├── judgment │ └── gpt-4-1106-preview.jsonl ├── math-user-eval.jsonl └── model_answer │ └── gpt-4-1106-preview.jsonl ├── get_answers.py ├── inference ├── __init__.py ├── api_models │ ├── __init__.py │ ├── chatglm.py │ ├── do_nothing.py │ └── gpt_4.py ├── models.py └── utils.py ├── judge.py ├── requirements.txt ├── scripts ├── eval.sh ├── infer.sh └── show.sh └── show_result.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/README.md -------------------------------------------------------------------------------- /config/dimension_definition.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/config/dimension_definition.json -------------------------------------------------------------------------------- /config/dimension_set.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/config/dimension_set.json -------------------------------------------------------------------------------- /config/first2second_mapping.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/config/first2second_mapping.json -------------------------------------------------------------------------------- /config/mathusereval.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/config/mathusereval.json -------------------------------------------------------------------------------- /config/multi-dimension.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/config/multi-dimension.json -------------------------------------------------------------------------------- /config/subcategory_question_mapping.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/config/subcategory_question_mapping.json -------------------------------------------------------------------------------- /config/temperature.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/config/temperature.json -------------------------------------------------------------------------------- /data/judgment/gpt-4-1106-preview.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/data/judgment/gpt-4-1106-preview.jsonl -------------------------------------------------------------------------------- /data/math-user-eval.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/data/math-user-eval.jsonl -------------------------------------------------------------------------------- /data/model_answer/gpt-4-1106-preview.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/data/model_answer/gpt-4-1106-preview.jsonl -------------------------------------------------------------------------------- /get_answers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/get_answers.py -------------------------------------------------------------------------------- /inference/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /inference/api_models/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /inference/api_models/chatglm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/inference/api_models/chatglm.py -------------------------------------------------------------------------------- /inference/api_models/do_nothing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/inference/api_models/do_nothing.py -------------------------------------------------------------------------------- /inference/api_models/gpt_4.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/inference/api_models/gpt_4.py -------------------------------------------------------------------------------- /inference/models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/inference/models.py -------------------------------------------------------------------------------- /inference/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/inference/utils.py -------------------------------------------------------------------------------- /judge.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/judge.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/requirements.txt -------------------------------------------------------------------------------- /scripts/eval.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/scripts/eval.sh -------------------------------------------------------------------------------- /scripts/infer.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/scripts/infer.sh -------------------------------------------------------------------------------- /scripts/show.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/scripts/show.sh -------------------------------------------------------------------------------- /show_result.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/THUDM/ChatGLM-Math/HEAD/show_result.py --------------------------------------------------------------------------------