├── LICENSE ├── NOTICE ├── README.md ├── evaluate_tablevqa.sh ├── images ├── TableVQA-main.png └── samples.png ├── inference_examples.ipynb ├── outputs ├── gpt4v │ ├── fintabnetqa.json │ ├── vtabfact.json │ ├── vwtq.json │ └── vwtq_syn.json └── gpt4v_evaluated │ ├── fintabnetqa.json │ ├── vtabfact.json │ ├── vwtq.json │ └── vwtq_syn.json ├── requirements.txt ├── src ├── evaluate.py ├── evaluate_tablevqa_dataset.py └── example_prompts.py └── visualize.ipynb /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/LICENSE -------------------------------------------------------------------------------- /NOTICE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/NOTICE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/README.md -------------------------------------------------------------------------------- /evaluate_tablevqa.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/evaluate_tablevqa.sh -------------------------------------------------------------------------------- /images/TableVQA-main.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/images/TableVQA-main.png -------------------------------------------------------------------------------- /images/samples.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/images/samples.png -------------------------------------------------------------------------------- /inference_examples.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/inference_examples.ipynb -------------------------------------------------------------------------------- /outputs/gpt4v/fintabnetqa.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/outputs/gpt4v/fintabnetqa.json -------------------------------------------------------------------------------- /outputs/gpt4v/vtabfact.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/outputs/gpt4v/vtabfact.json -------------------------------------------------------------------------------- /outputs/gpt4v/vwtq.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/outputs/gpt4v/vwtq.json -------------------------------------------------------------------------------- /outputs/gpt4v/vwtq_syn.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/outputs/gpt4v/vwtq_syn.json -------------------------------------------------------------------------------- /outputs/gpt4v_evaluated/fintabnetqa.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/outputs/gpt4v_evaluated/fintabnetqa.json -------------------------------------------------------------------------------- /outputs/gpt4v_evaluated/vtabfact.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/outputs/gpt4v_evaluated/vtabfact.json -------------------------------------------------------------------------------- /outputs/gpt4v_evaluated/vwtq.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/outputs/gpt4v_evaluated/vwtq.json -------------------------------------------------------------------------------- /outputs/gpt4v_evaluated/vwtq_syn.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/outputs/gpt4v_evaluated/vwtq_syn.json -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | transformers 2 | typing 3 | pillow 4 | datasets 5 | -------------------------------------------------------------------------------- /src/evaluate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/src/evaluate.py -------------------------------------------------------------------------------- /src/evaluate_tablevqa_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/src/evaluate_tablevqa_dataset.py -------------------------------------------------------------------------------- /src/example_prompts.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/src/example_prompts.py -------------------------------------------------------------------------------- /visualize.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/naver-ai/tablevqabench/HEAD/visualize.ipynb --------------------------------------------------------------------------------