├── GAT.py ├── LICENSE ├── README.md ├── coco_sims └── coco_sims.txt ├── data.py ├── data ├── coco │ ├── annotations.zip │ ├── download.sh │ └── images └── f30k │ ├── dataset_flickr30k.zip │ └── images ├── data_bert.py ├── evaluation.py ├── evaluation_bert.py ├── figures └── model.jpg ├── flickr_sims └── flickr_sims.txt ├── model.py ├── model_bert.py ├── pytorch_pretrained_bert ├── .DS_Store ├── file_utils.py ├── modeling.py ├── optimization.py └── tokenization.py ├── rerank.py ├── resnet.py ├── runs ├── BERT │ └── bert_models └── GRU │ └── gru_models ├── test_bert_cc.sh ├── test_bert_f.sh ├── test_gru_cc.sh ├── test_gru_f.sh ├── train.py ├── train_bert.py ├── uncased_L-12_H-768_A-12 └── bert_pretrained_model ├── vocab.py └── vocab ├── 111 ├── 10crop_precomp_vocab.pkl ├── coco_precomp_vocab.pkl ├── coco_resnet_precomp_vocab.pkl ├── coco_vgg_precomp_vocab.pkl ├── coco_vocab.pkl ├── f30k_precomp_vocab.pkl ├── f30k_vocab.pkl ├── f8k_precomp_vocab.pkl └── f8k_vocab.pkl /GAT.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/GAT.py -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/README.md -------------------------------------------------------------------------------- /coco_sims/coco_sims.txt: -------------------------------------------------------------------------------- 1 | Path to save similarity matrixes during inference stage of MSCOCO. 2 | -------------------------------------------------------------------------------- /data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/data.py -------------------------------------------------------------------------------- /data/coco/annotations.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/data/coco/annotations.zip -------------------------------------------------------------------------------- /data/coco/download.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/data/coco/download.sh -------------------------------------------------------------------------------- /data/coco/images: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /data/f30k/dataset_flickr30k.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/data/f30k/dataset_flickr30k.zip -------------------------------------------------------------------------------- /data/f30k/images: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /data_bert.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/data_bert.py -------------------------------------------------------------------------------- /evaluation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/evaluation.py -------------------------------------------------------------------------------- /evaluation_bert.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/evaluation_bert.py -------------------------------------------------------------------------------- /figures/model.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/figures/model.jpg -------------------------------------------------------------------------------- /flickr_sims/flickr_sims.txt: -------------------------------------------------------------------------------- 1 | Path to save similarity matrixes during inference stage of Flickr30K. 2 | -------------------------------------------------------------------------------- /model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/model.py -------------------------------------------------------------------------------- /model_bert.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/model_bert.py -------------------------------------------------------------------------------- /pytorch_pretrained_bert/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/pytorch_pretrained_bert/.DS_Store -------------------------------------------------------------------------------- /pytorch_pretrained_bert/file_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/pytorch_pretrained_bert/file_utils.py -------------------------------------------------------------------------------- /pytorch_pretrained_bert/modeling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/pytorch_pretrained_bert/modeling.py -------------------------------------------------------------------------------- /pytorch_pretrained_bert/optimization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/pytorch_pretrained_bert/optimization.py -------------------------------------------------------------------------------- /pytorch_pretrained_bert/tokenization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/pytorch_pretrained_bert/tokenization.py -------------------------------------------------------------------------------- /rerank.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/rerank.py -------------------------------------------------------------------------------- /resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/resnet.py -------------------------------------------------------------------------------- /runs/BERT/bert_models: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /runs/GRU/gru_models: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /test_bert_cc.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/test_bert_cc.sh -------------------------------------------------------------------------------- /test_bert_f.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/test_bert_f.sh -------------------------------------------------------------------------------- /test_gru_cc.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/test_gru_cc.sh -------------------------------------------------------------------------------- /test_gru_f.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/test_gru_f.sh -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/train.py -------------------------------------------------------------------------------- /train_bert.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/train_bert.py -------------------------------------------------------------------------------- /uncased_L-12_H-768_A-12/bert_pretrained_model: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /vocab.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/vocab.py -------------------------------------------------------------------------------- /vocab/10crop_precomp_vocab.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/vocab/10crop_precomp_vocab.pkl -------------------------------------------------------------------------------- /vocab/111: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /vocab/coco_precomp_vocab.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/vocab/coco_precomp_vocab.pkl -------------------------------------------------------------------------------- /vocab/coco_resnet_precomp_vocab.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/vocab/coco_resnet_precomp_vocab.pkl -------------------------------------------------------------------------------- /vocab/coco_vgg_precomp_vocab.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/vocab/coco_vgg_precomp_vocab.pkl -------------------------------------------------------------------------------- /vocab/coco_vocab.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/vocab/coco_vocab.pkl -------------------------------------------------------------------------------- /vocab/f30k_precomp_vocab.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/vocab/f30k_precomp_vocab.pkl -------------------------------------------------------------------------------- /vocab/f30k_vocab.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/vocab/f30k_vocab.pkl -------------------------------------------------------------------------------- /vocab/f8k_precomp_vocab.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/vocab/f8k_precomp_vocab.pkl -------------------------------------------------------------------------------- /vocab/f8k_vocab.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kywen1119/DSRAN/HEAD/vocab/f8k_vocab.pkl --------------------------------------------------------------------------------