├── .gitignore ├── Pre_Experiment ├── customize_model.py ├── data │ ├── preprocess_casehold.py │ ├── preprocess_finfact.py │ └── preprocess_pubhealth.py ├── model │ └── .gitkeep ├── pre_experiment.py ├── pre_experiment.sh └── result │ └── .gitkeep ├── RL_KTO ├── data │ └── dataset_info.json ├── ds_z3_offload_config.json ├── process_kto.py └── train_kto.sh ├── data └── dataset_info.json ├── demo ├── llama_pubmedqa_rare.sh └── qwenvl_mmrait_rare.sh ├── eval └── eval.py ├── image ├── Case_Study.png ├── Overview_RARE.png ├── benchmark.png └── logo.png ├── inference ├── api_infer_post.py ├── vllm_infer_mm.py ├── vllm_infer_text.py └── vllm_infer_text_reject_sampling.py ├── license ├── process ├── process_casehold.py ├── process_finfact.py ├── process_medqa.py ├── process_mmrait.py ├── process_pubhealth.py ├── process_pubmed.py └── select_true.py ├── readme.md ├── requirements.txt └── train ├── accelerate_config.yaml ├── fsdp_config_llama.json ├── fsdp_config_mistral.json ├── fsdp_config_qwen.json ├── merge_lora.yaml ├── sft.py ├── sft.sh ├── train.py ├── training_args.yaml ├── training_args_lora.yaml └── training_args_mm.yaml /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/.gitignore -------------------------------------------------------------------------------- /Pre_Experiment/customize_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/Pre_Experiment/customize_model.py -------------------------------------------------------------------------------- /Pre_Experiment/data/preprocess_casehold.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/Pre_Experiment/data/preprocess_casehold.py -------------------------------------------------------------------------------- /Pre_Experiment/data/preprocess_finfact.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/Pre_Experiment/data/preprocess_finfact.py -------------------------------------------------------------------------------- /Pre_Experiment/data/preprocess_pubhealth.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/Pre_Experiment/data/preprocess_pubhealth.py -------------------------------------------------------------------------------- /Pre_Experiment/model/.gitkeep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /Pre_Experiment/pre_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/Pre_Experiment/pre_experiment.py -------------------------------------------------------------------------------- /Pre_Experiment/pre_experiment.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/Pre_Experiment/pre_experiment.sh -------------------------------------------------------------------------------- /Pre_Experiment/result/.gitkeep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /RL_KTO/data/dataset_info.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/RL_KTO/data/dataset_info.json -------------------------------------------------------------------------------- /RL_KTO/ds_z3_offload_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/RL_KTO/ds_z3_offload_config.json -------------------------------------------------------------------------------- /RL_KTO/process_kto.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/RL_KTO/process_kto.py -------------------------------------------------------------------------------- /RL_KTO/train_kto.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/RL_KTO/train_kto.sh -------------------------------------------------------------------------------- /data/dataset_info.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/data/dataset_info.json -------------------------------------------------------------------------------- /demo/llama_pubmedqa_rare.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/demo/llama_pubmedqa_rare.sh -------------------------------------------------------------------------------- /demo/qwenvl_mmrait_rare.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/demo/qwenvl_mmrait_rare.sh -------------------------------------------------------------------------------- /eval/eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/eval/eval.py -------------------------------------------------------------------------------- /image/Case_Study.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/image/Case_Study.png -------------------------------------------------------------------------------- /image/Overview_RARE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/image/Overview_RARE.png -------------------------------------------------------------------------------- /image/benchmark.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/image/benchmark.png -------------------------------------------------------------------------------- /image/logo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/image/logo.png -------------------------------------------------------------------------------- /inference/api_infer_post.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/inference/api_infer_post.py -------------------------------------------------------------------------------- /inference/vllm_infer_mm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/inference/vllm_infer_mm.py -------------------------------------------------------------------------------- /inference/vllm_infer_text.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/inference/vllm_infer_text.py -------------------------------------------------------------------------------- /inference/vllm_infer_text_reject_sampling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/inference/vllm_infer_text_reject_sampling.py -------------------------------------------------------------------------------- /license: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/license -------------------------------------------------------------------------------- /process/process_casehold.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/process/process_casehold.py -------------------------------------------------------------------------------- /process/process_finfact.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/process/process_finfact.py -------------------------------------------------------------------------------- /process/process_medqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/process/process_medqa.py -------------------------------------------------------------------------------- /process/process_mmrait.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/process/process_mmrait.py -------------------------------------------------------------------------------- /process/process_pubhealth.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/process/process_pubhealth.py -------------------------------------------------------------------------------- /process/process_pubmed.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/process/process_pubmed.py -------------------------------------------------------------------------------- /process/select_true.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/process/select_true.py -------------------------------------------------------------------------------- /readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/readme.md -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/requirements.txt -------------------------------------------------------------------------------- /train/accelerate_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/accelerate_config.yaml -------------------------------------------------------------------------------- /train/fsdp_config_llama.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/fsdp_config_llama.json -------------------------------------------------------------------------------- /train/fsdp_config_mistral.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/fsdp_config_mistral.json -------------------------------------------------------------------------------- /train/fsdp_config_qwen.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/fsdp_config_qwen.json -------------------------------------------------------------------------------- /train/merge_lora.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/merge_lora.yaml -------------------------------------------------------------------------------- /train/sft.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/sft.py -------------------------------------------------------------------------------- /train/sft.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/sft.sh -------------------------------------------------------------------------------- /train/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/train.py -------------------------------------------------------------------------------- /train/training_args.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/training_args.yaml -------------------------------------------------------------------------------- /train/training_args_lora.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/training_args_lora.yaml -------------------------------------------------------------------------------- /train/training_args_mm.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenDCAI/RARE/HEAD/train/training_args_mm.yaml --------------------------------------------------------------------------------