├── .gitignore ├── README.md ├── assets ├── main_radar_fig.pdf └── main_radar_fig.png ├── tokenization ├── mathmix_combine.py ├── tokenize_metamath.py └── tokenize_tutorchat.py ├── tutoreval ├── README.md ├── generate.py ├── generate.sh ├── get_results.py ├── grade.py ├── grade.sh ├── human_gpt_grades.csv ├── merge_generations.py └── templates │ ├── closedbook_generation_template.txt │ ├── closedbook_grading_template.txt │ ├── generation_template.txt │ └── grading_template.txt └── utils ├── generation_utils.py └── openai_utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/README.md -------------------------------------------------------------------------------- /assets/main_radar_fig.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/assets/main_radar_fig.pdf -------------------------------------------------------------------------------- /assets/main_radar_fig.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/assets/main_radar_fig.png -------------------------------------------------------------------------------- /tokenization/mathmix_combine.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tokenization/mathmix_combine.py -------------------------------------------------------------------------------- /tokenization/tokenize_metamath.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tokenization/tokenize_metamath.py -------------------------------------------------------------------------------- /tokenization/tokenize_tutorchat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tokenization/tokenize_tutorchat.py -------------------------------------------------------------------------------- /tutoreval/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/README.md -------------------------------------------------------------------------------- /tutoreval/generate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/generate.py -------------------------------------------------------------------------------- /tutoreval/generate.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/generate.sh -------------------------------------------------------------------------------- /tutoreval/get_results.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/get_results.py -------------------------------------------------------------------------------- /tutoreval/grade.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/grade.py -------------------------------------------------------------------------------- /tutoreval/grade.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/grade.sh -------------------------------------------------------------------------------- /tutoreval/human_gpt_grades.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/human_gpt_grades.csv -------------------------------------------------------------------------------- /tutoreval/merge_generations.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/merge_generations.py -------------------------------------------------------------------------------- /tutoreval/templates/closedbook_generation_template.txt: -------------------------------------------------------------------------------- 1 | {{QUESTION}} -------------------------------------------------------------------------------- /tutoreval/templates/closedbook_grading_template.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/templates/closedbook_grading_template.txt -------------------------------------------------------------------------------- /tutoreval/templates/generation_template.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/templates/generation_template.txt -------------------------------------------------------------------------------- /tutoreval/templates/grading_template.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/tutoreval/templates/grading_template.txt -------------------------------------------------------------------------------- /utils/generation_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/utils/generation_utils.py -------------------------------------------------------------------------------- /utils/openai_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/princeton-nlp/LM-Science-Tutor/HEAD/utils/openai_utils.py --------------------------------------------------------------------------------