├── .gitignore ├── LICENSE ├── README.md ├── human_annotations ├── README.md ├── compute_correlation.ipynb ├── human_annotations.json └── human_annotations_with_scores.json ├── requirements.txt ├── sample ├── coco_301091.jpg ├── drawbench_52.jpg ├── drawbench_8.jpg ├── sample_evaluation_result.json ├── sample_imgs.json ├── sample_question_answers.json └── sample_text_inputs.json ├── setup.py ├── static ├── question_type.png ├── tifa_benchmark_new.png ├── tifa_leaderboard.png └── tifa_webteaser2.png ├── tifa_test.py ├── tifa_v1.0 ├── README.md ├── tifa_v1.0_question_answers.json └── tifa_v1.0_text_inputs.json └── tifascore ├── __init__.py ├── mc_sbert.py ├── openai_api.py ├── question_filter.py ├── question_gen.py ├── question_gen_llama2.py ├── tifa_score.py ├── unifiedqa.py └── vqa_models.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/README.md -------------------------------------------------------------------------------- /human_annotations/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/human_annotations/README.md -------------------------------------------------------------------------------- /human_annotations/compute_correlation.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/human_annotations/compute_correlation.ipynb -------------------------------------------------------------------------------- /human_annotations/human_annotations.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/human_annotations/human_annotations.json -------------------------------------------------------------------------------- /human_annotations/human_annotations_with_scores.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/human_annotations/human_annotations_with_scores.json -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/requirements.txt -------------------------------------------------------------------------------- /sample/coco_301091.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/sample/coco_301091.jpg -------------------------------------------------------------------------------- /sample/drawbench_52.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/sample/drawbench_52.jpg -------------------------------------------------------------------------------- /sample/drawbench_8.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/sample/drawbench_8.jpg -------------------------------------------------------------------------------- /sample/sample_evaluation_result.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/sample/sample_evaluation_result.json -------------------------------------------------------------------------------- /sample/sample_imgs.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/sample/sample_imgs.json -------------------------------------------------------------------------------- /sample/sample_question_answers.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/sample/sample_question_answers.json -------------------------------------------------------------------------------- /sample/sample_text_inputs.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/sample/sample_text_inputs.json -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/setup.py -------------------------------------------------------------------------------- /static/question_type.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/static/question_type.png -------------------------------------------------------------------------------- /static/tifa_benchmark_new.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/static/tifa_benchmark_new.png -------------------------------------------------------------------------------- /static/tifa_leaderboard.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/static/tifa_leaderboard.png -------------------------------------------------------------------------------- /static/tifa_webteaser2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/static/tifa_webteaser2.png -------------------------------------------------------------------------------- /tifa_test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifa_test.py -------------------------------------------------------------------------------- /tifa_v1.0/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifa_v1.0/README.md -------------------------------------------------------------------------------- /tifa_v1.0/tifa_v1.0_question_answers.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifa_v1.0/tifa_v1.0_question_answers.json -------------------------------------------------------------------------------- /tifa_v1.0/tifa_v1.0_text_inputs.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifa_v1.0/tifa_v1.0_text_inputs.json -------------------------------------------------------------------------------- /tifascore/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifascore/__init__.py -------------------------------------------------------------------------------- /tifascore/mc_sbert.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifascore/mc_sbert.py -------------------------------------------------------------------------------- /tifascore/openai_api.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifascore/openai_api.py -------------------------------------------------------------------------------- /tifascore/question_filter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifascore/question_filter.py -------------------------------------------------------------------------------- /tifascore/question_gen.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifascore/question_gen.py -------------------------------------------------------------------------------- /tifascore/question_gen_llama2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifascore/question_gen_llama2.py -------------------------------------------------------------------------------- /tifascore/tifa_score.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifascore/tifa_score.py -------------------------------------------------------------------------------- /tifascore/unifiedqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifascore/unifiedqa.py -------------------------------------------------------------------------------- /tifascore/vqa_models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yushi-Hu/tifa/HEAD/tifascore/vqa_models.py --------------------------------------------------------------------------------