├── README.md ├── evaluation └── eval_from_json.py ├── hfdata_to_eval_vqa.py ├── inference ├── get_vlm_output_random.py ├── get_vlm_output_sglang.py ├── interface │ └── qwen2vl_interface.py └── utils.py ├── prompt ├── prompt_manager.py └── prompts_reasoning │ ├── 00_yaw_vqa.txt │ ├── 01_xy2d_vqa.txt │ ├── 02_depth_vqa.txt │ ├── 03_dis_vqa.txt │ ├── 04_lf_vqa.txt │ └── 05_fb_vqa.txt ├── requirements.txt └── training ├── grpo └── grpo.py └── sft ├── gen_cot.py └── summarize_rules.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/README.md -------------------------------------------------------------------------------- /evaluation/eval_from_json.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/evaluation/eval_from_json.py -------------------------------------------------------------------------------- /hfdata_to_eval_vqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/hfdata_to_eval_vqa.py -------------------------------------------------------------------------------- /inference/get_vlm_output_random.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/inference/get_vlm_output_random.py -------------------------------------------------------------------------------- /inference/get_vlm_output_sglang.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/inference/get_vlm_output_sglang.py -------------------------------------------------------------------------------- /inference/interface/qwen2vl_interface.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/inference/interface/qwen2vl_interface.py -------------------------------------------------------------------------------- /inference/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/inference/utils.py -------------------------------------------------------------------------------- /prompt/prompt_manager.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/prompt/prompt_manager.py -------------------------------------------------------------------------------- /prompt/prompts_reasoning/00_yaw_vqa.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/prompt/prompts_reasoning/00_yaw_vqa.txt -------------------------------------------------------------------------------- /prompt/prompts_reasoning/01_xy2d_vqa.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/prompt/prompts_reasoning/01_xy2d_vqa.txt -------------------------------------------------------------------------------- /prompt/prompts_reasoning/02_depth_vqa.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/prompt/prompts_reasoning/02_depth_vqa.txt -------------------------------------------------------------------------------- /prompt/prompts_reasoning/03_dis_vqa.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/prompt/prompts_reasoning/03_dis_vqa.txt -------------------------------------------------------------------------------- /prompt/prompts_reasoning/04_lf_vqa.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/prompt/prompts_reasoning/04_lf_vqa.txt -------------------------------------------------------------------------------- /prompt/prompts_reasoning/05_fb_vqa.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/prompt/prompts_reasoning/05_fb_vqa.txt -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/requirements.txt -------------------------------------------------------------------------------- /training/grpo/grpo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/training/grpo/grpo.py -------------------------------------------------------------------------------- /training/sft/gen_cot.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/training/sft/gen_cot.py -------------------------------------------------------------------------------- /training/sft/summarize_rules.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/XiandaGuo/Drive-MLLM/HEAD/training/sft/summarize_rules.py --------------------------------------------------------------------------------