├── .gitignore ├── data └── flickr30k │ ├── test_imgid2idx.pkl │ ├── train_imgid2idx.pkl │ └── val_imgid2idx.pkl ├── dataset.py ├── main.py ├── model.py ├── readme.md ├── test.py ├── tools ├── avg_proposals.py ├── prepare_data.sh ├── prepare_detection.sh ├── run_faster_rcnn.sh └── split_pkl_idx.py ├── train_model.py └── utils ├── __init__.py ├── evaluator.py ├── logger.py ├── utils.py ├── wordembeddings.py └── wordindexer.py /.gitignore: -------------------------------------------------------------------------------- 1 | data 2 | .idea 3 | .DS_Store 4 | 5 | -------------------------------------------------------------------------------- /data/flickr30k/test_imgid2idx.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/data/flickr30k/test_imgid2idx.pkl -------------------------------------------------------------------------------- /data/flickr30k/train_imgid2idx.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/data/flickr30k/train_imgid2idx.pkl -------------------------------------------------------------------------------- /data/flickr30k/val_imgid2idx.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/data/flickr30k/val_imgid2idx.pkl -------------------------------------------------------------------------------- /dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/dataset.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/main.py -------------------------------------------------------------------------------- /model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/model.py -------------------------------------------------------------------------------- /readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/readme.md -------------------------------------------------------------------------------- /test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/test.py -------------------------------------------------------------------------------- /tools/avg_proposals.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/tools/avg_proposals.py -------------------------------------------------------------------------------- /tools/prepare_data.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/tools/prepare_data.sh -------------------------------------------------------------------------------- /tools/prepare_detection.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/tools/prepare_detection.sh -------------------------------------------------------------------------------- /tools/run_faster_rcnn.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/tools/run_faster_rcnn.sh -------------------------------------------------------------------------------- /tools/split_pkl_idx.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/tools/split_pkl_idx.py -------------------------------------------------------------------------------- /train_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/train_model.py -------------------------------------------------------------------------------- /utils/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /utils/evaluator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/utils/evaluator.py -------------------------------------------------------------------------------- /utils/logger.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/utils/logger.py -------------------------------------------------------------------------------- /utils/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/utils/utils.py -------------------------------------------------------------------------------- /utils/wordembeddings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/utils/wordembeddings.py -------------------------------------------------------------------------------- /utils/wordindexer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/qinzzz/Multimodal-Alignment-Framework/HEAD/utils/wordindexer.py --------------------------------------------------------------------------------