├── .gitignore ├── LICENSE ├── README.md ├── camobjbench ├── eval_mllm.py └── run_eval_batch.sh ├── conversation.py ├── dataset ├── bench.json ├── choose_benchmark.py ├── data2jsoin.py ├── get_data_COD10K_v3.py ├── get_data_CamouflageData.py ├── get_data_MoCA_Video.py ├── get_data_PlantCAMO1250.py ├── questions │ ├── bbox_position.jsonl │ ├── easy_vqa.jsonl │ ├── hard_vqa.jsonl │ ├── image_caption.json │ ├── mask_FT.jsonl │ ├── mask_matching.jsonl │ └── object_count.jsonl ├── train_data │ ├── camobj_align.json │ └── camobj_instruct.json └── utils │ └── analysis_image.py ├── mllm_eval ├── __init__.py ├── fuyu_eval.py ├── idefics1_eval.py ├── instructblip_eval.py ├── kosmos2_eval.py ├── llava_eval.py ├── minicpmv_eval.py └── qwenVL_eval.py └── utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/README.md -------------------------------------------------------------------------------- /camobjbench/eval_mllm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/camobjbench/eval_mllm.py -------------------------------------------------------------------------------- /camobjbench/run_eval_batch.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/camobjbench/run_eval_batch.sh -------------------------------------------------------------------------------- /conversation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/conversation.py -------------------------------------------------------------------------------- /dataset/bench.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/bench.json -------------------------------------------------------------------------------- /dataset/choose_benchmark.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/choose_benchmark.py -------------------------------------------------------------------------------- /dataset/data2jsoin.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/data2jsoin.py -------------------------------------------------------------------------------- /dataset/get_data_COD10K_v3.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/get_data_COD10K_v3.py -------------------------------------------------------------------------------- /dataset/get_data_CamouflageData.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/get_data_CamouflageData.py -------------------------------------------------------------------------------- /dataset/get_data_MoCA_Video.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/get_data_MoCA_Video.py -------------------------------------------------------------------------------- /dataset/get_data_PlantCAMO1250.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/get_data_PlantCAMO1250.py -------------------------------------------------------------------------------- /dataset/questions/bbox_position.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/questions/bbox_position.jsonl -------------------------------------------------------------------------------- /dataset/questions/easy_vqa.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/questions/easy_vqa.jsonl -------------------------------------------------------------------------------- /dataset/questions/hard_vqa.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/questions/hard_vqa.jsonl -------------------------------------------------------------------------------- /dataset/questions/image_caption.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/questions/image_caption.json -------------------------------------------------------------------------------- /dataset/questions/mask_FT.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/questions/mask_FT.jsonl -------------------------------------------------------------------------------- /dataset/questions/mask_matching.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/questions/mask_matching.jsonl -------------------------------------------------------------------------------- /dataset/questions/object_count.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/questions/object_count.jsonl -------------------------------------------------------------------------------- /dataset/train_data/camobj_align.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/train_data/camobj_align.json -------------------------------------------------------------------------------- /dataset/train_data/camobj_instruct.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/train_data/camobj_instruct.json -------------------------------------------------------------------------------- /dataset/utils/analysis_image.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/dataset/utils/analysis_image.py -------------------------------------------------------------------------------- /mllm_eval/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/mllm_eval/__init__.py -------------------------------------------------------------------------------- /mllm_eval/fuyu_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/mllm_eval/fuyu_eval.py -------------------------------------------------------------------------------- /mllm_eval/idefics1_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/mllm_eval/idefics1_eval.py -------------------------------------------------------------------------------- /mllm_eval/instructblip_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/mllm_eval/instructblip_eval.py -------------------------------------------------------------------------------- /mllm_eval/kosmos2_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/mllm_eval/kosmos2_eval.py -------------------------------------------------------------------------------- /mllm_eval/llava_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/mllm_eval/llava_eval.py -------------------------------------------------------------------------------- /mllm_eval/minicpmv_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/mllm_eval/minicpmv_eval.py -------------------------------------------------------------------------------- /mllm_eval/qwenVL_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/mllm_eval/qwenVL_eval.py -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JCruan519/MM-CamObj/HEAD/utils.py --------------------------------------------------------------------------------