├── DATA.md ├── Data ├── actions_charades_classes.txt ├── knowledge_base │ ├── retrieved_episode_from_scenes_test.csv │ ├── retrieved_episode_from_scenes_train.csv │ ├── retrieved_episode_from_scenes_val.csv │ └── tbbt_summaries.csv ├── vg_objects.json └── vg_predicates.json ├── Images └── model.png ├── LICENSE ├── README.md ├── Source ├── branch_observe.py ├── branch_read.py ├── branch_recall.py ├── dataloader_knowit.py ├── dataloader_tvqa.py ├── fuse_branches.py ├── generate_scene_description.py ├── train_branch.py ├── utils.py └── utils_graphs.py └── Tools ├── download_summaries.py └── video_story_identification.py /DATA.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/DATA.md -------------------------------------------------------------------------------- /Data/actions_charades_classes.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Data/actions_charades_classes.txt -------------------------------------------------------------------------------- /Data/knowledge_base/retrieved_episode_from_scenes_test.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Data/knowledge_base/retrieved_episode_from_scenes_test.csv -------------------------------------------------------------------------------- /Data/knowledge_base/retrieved_episode_from_scenes_train.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Data/knowledge_base/retrieved_episode_from_scenes_train.csv -------------------------------------------------------------------------------- /Data/knowledge_base/retrieved_episode_from_scenes_val.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Data/knowledge_base/retrieved_episode_from_scenes_val.csv -------------------------------------------------------------------------------- /Data/knowledge_base/tbbt_summaries.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Data/knowledge_base/tbbt_summaries.csv -------------------------------------------------------------------------------- /Data/vg_objects.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Data/vg_objects.json -------------------------------------------------------------------------------- /Data/vg_predicates.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Data/vg_predicates.json -------------------------------------------------------------------------------- /Images/model.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Images/model.png -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/README.md -------------------------------------------------------------------------------- /Source/branch_observe.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Source/branch_observe.py -------------------------------------------------------------------------------- /Source/branch_read.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Source/branch_read.py -------------------------------------------------------------------------------- /Source/branch_recall.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Source/branch_recall.py -------------------------------------------------------------------------------- /Source/dataloader_knowit.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Source/dataloader_knowit.py -------------------------------------------------------------------------------- /Source/dataloader_tvqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Source/dataloader_tvqa.py -------------------------------------------------------------------------------- /Source/fuse_branches.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Source/fuse_branches.py -------------------------------------------------------------------------------- /Source/generate_scene_description.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Source/generate_scene_description.py -------------------------------------------------------------------------------- /Source/train_branch.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Source/train_branch.py -------------------------------------------------------------------------------- /Source/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Source/utils.py -------------------------------------------------------------------------------- /Source/utils_graphs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Source/utils_graphs.py -------------------------------------------------------------------------------- /Tools/download_summaries.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Tools/download_summaries.py -------------------------------------------------------------------------------- /Tools/video_story_identification.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/noagarcia/ROLL-VideoQA/HEAD/Tools/video_story_identification.py --------------------------------------------------------------------------------