├── .gitignore ├── LICENSE ├── README.md ├── assets ├── example_image1.jpg ├── example_image2.jpg ├── example_video.mp4 └── overview.png ├── eval ├── mmbench │ └── evaluate_mmbench.py ├── mme │ ├── README.md │ ├── calculation.py │ └── eval.py ├── mmmu │ ├── answer_dict_val.json │ ├── data_utils.py │ ├── eval_utils.py │ ├── evaluate_mmmu.py │ ├── evaluate_mmmu_cot.py │ └── main_eval_only.py ├── mvbench │ └── evaluate_mvbench.py ├── scienceqa │ └── evaluate_scienceqa.py ├── seed │ ├── calculation.py │ └── evaluate_seed.py └── vqa │ ├── convert_gqa_for_eval.py │ ├── evaluate_vqa.py │ ├── infographicsvqa_eval.py │ └── textvqa_eval.py ├── evaluate.sh ├── evaluate_launch.sh ├── requirements.txt └── utils └── preprocess.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/README.md -------------------------------------------------------------------------------- /assets/example_image1.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/assets/example_image1.jpg -------------------------------------------------------------------------------- /assets/example_image2.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/assets/example_image2.jpg -------------------------------------------------------------------------------- /assets/example_video.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/assets/example_video.mp4 -------------------------------------------------------------------------------- /assets/overview.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/assets/overview.png -------------------------------------------------------------------------------- /eval/mmbench/evaluate_mmbench.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mmbench/evaluate_mmbench.py -------------------------------------------------------------------------------- /eval/mme/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mme/README.md -------------------------------------------------------------------------------- /eval/mme/calculation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mme/calculation.py -------------------------------------------------------------------------------- /eval/mme/eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mme/eval.py -------------------------------------------------------------------------------- /eval/mmmu/answer_dict_val.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mmmu/answer_dict_val.json -------------------------------------------------------------------------------- /eval/mmmu/data_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mmmu/data_utils.py -------------------------------------------------------------------------------- /eval/mmmu/eval_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mmmu/eval_utils.py -------------------------------------------------------------------------------- /eval/mmmu/evaluate_mmmu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mmmu/evaluate_mmmu.py -------------------------------------------------------------------------------- /eval/mmmu/evaluate_mmmu_cot.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mmmu/evaluate_mmmu_cot.py -------------------------------------------------------------------------------- /eval/mmmu/main_eval_only.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mmmu/main_eval_only.py -------------------------------------------------------------------------------- /eval/mvbench/evaluate_mvbench.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/mvbench/evaluate_mvbench.py -------------------------------------------------------------------------------- /eval/scienceqa/evaluate_scienceqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/scienceqa/evaluate_scienceqa.py -------------------------------------------------------------------------------- /eval/seed/calculation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/seed/calculation.py -------------------------------------------------------------------------------- /eval/seed/evaluate_seed.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/seed/evaluate_seed.py -------------------------------------------------------------------------------- /eval/vqa/convert_gqa_for_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/vqa/convert_gqa_for_eval.py -------------------------------------------------------------------------------- /eval/vqa/evaluate_vqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/vqa/evaluate_vqa.py -------------------------------------------------------------------------------- /eval/vqa/infographicsvqa_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/vqa/infographicsvqa_eval.py -------------------------------------------------------------------------------- /eval/vqa/textvqa_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/eval/vqa/textvqa_eval.py -------------------------------------------------------------------------------- /evaluate.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/evaluate.sh -------------------------------------------------------------------------------- /evaluate_launch.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/evaluate_launch.sh -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/requirements.txt -------------------------------------------------------------------------------- /utils/preprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OpenGVLab/PVC/HEAD/utils/preprocess.py --------------------------------------------------------------------------------