├── .gitignore ├── README.md ├── figures ├── average_performance_comparison.jpg └── motivation.jpg ├── inference_llms.py ├── inference_merged_llms_instruct_math_code.py ├── math_code_data ├── MATH_test.jsonl ├── gsm8k_test.jsonl └── mbpp.test.jsonl ├── merge_llms.py ├── model_merging_methods ├── mask_weights_utils.py ├── merging_methods.py └── task_vector.py └── utils ├── evaluate_llms_utils.py ├── load_config.py └── utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/README.md -------------------------------------------------------------------------------- /figures/average_performance_comparison.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/figures/average_performance_comparison.jpg -------------------------------------------------------------------------------- /figures/motivation.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/figures/motivation.jpg -------------------------------------------------------------------------------- /inference_llms.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/inference_llms.py -------------------------------------------------------------------------------- /inference_merged_llms_instruct_math_code.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/inference_merged_llms_instruct_math_code.py -------------------------------------------------------------------------------- /math_code_data/MATH_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/math_code_data/MATH_test.jsonl -------------------------------------------------------------------------------- /math_code_data/gsm8k_test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/math_code_data/gsm8k_test.jsonl -------------------------------------------------------------------------------- /math_code_data/mbpp.test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/math_code_data/mbpp.test.jsonl -------------------------------------------------------------------------------- /merge_llms.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/merge_llms.py -------------------------------------------------------------------------------- /model_merging_methods/mask_weights_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/model_merging_methods/mask_weights_utils.py -------------------------------------------------------------------------------- /model_merging_methods/merging_methods.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/model_merging_methods/merging_methods.py -------------------------------------------------------------------------------- /model_merging_methods/task_vector.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/model_merging_methods/task_vector.py -------------------------------------------------------------------------------- /utils/evaluate_llms_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/utils/evaluate_llms_utils.py -------------------------------------------------------------------------------- /utils/load_config.py: -------------------------------------------------------------------------------- 1 | cache_dir = "/mnt/data/yule/.cache" 2 | -------------------------------------------------------------------------------- /utils/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yule-BUAA/MergeLLM/HEAD/utils/utils.py --------------------------------------------------------------------------------