├── .gitignore ├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── LICENSE ├── README.md ├── data └── all_data_release.json ├── figs └── fig_overview.jpg ├── outputs └── example.jsonl └── scripts ├── 0_download_data.py ├── 1_run_model_as_judge_gpt4o.py └── 2_get_accuracy.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/.gitignore -------------------------------------------------------------------------------- /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/CONTRIBUTING.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/README.md -------------------------------------------------------------------------------- /data/all_data_release.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/data/all_data_release.json -------------------------------------------------------------------------------- /figs/fig_overview.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/figs/fig_overview.jpg -------------------------------------------------------------------------------- /outputs/example.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/outputs/example.jsonl -------------------------------------------------------------------------------- /scripts/0_download_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/scripts/0_download_data.py -------------------------------------------------------------------------------- /scripts/1_run_model_as_judge_gpt4o.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/scripts/1_run_model_as_judge_gpt4o.py -------------------------------------------------------------------------------- /scripts/2_get_accuracy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/multimodal_rewardbench/HEAD/scripts/2_get_accuracy.py --------------------------------------------------------------------------------