├── .gitignore ├── README.md ├── __pycache__ ├── arguments.cpython-311.pyc ├── arguments.cpython-39.pyc └── visualize.cpython-39.pyc ├── arguments.py ├── data ├── coco │ ├── coco_testall.jsonl │ ├── coco_train.jsonl │ ├── id_mapping.json │ ├── testall_caps.txt │ ├── testall_ids.txt │ ├── train_caps.txt │ └── train_ids.txt └── f30k │ ├── f30k_train.jsonl │ ├── id_mapping.json │ ├── test_caps.txt │ ├── test_ids.txt │ ├── train_caps.txt │ └── train_ids.txt ├── eval.py ├── imgs └── intro.jpg ├── lib ├── __init__.py ├── __pycache__ │ ├── __init__.cpython-311.pyc │ ├── __init__.cpython-39.pyc │ ├── cross_net.cpython-311.pyc │ ├── cross_net.cpython-39.pyc │ ├── encoders.cpython-311.pyc │ ├── encoders.cpython-39.pyc │ ├── evaluation.cpython-311.pyc │ ├── evaluation.cpython-39.pyc │ ├── image_caption.cpython-311.pyc │ ├── image_caption.cpython-39.pyc │ ├── loss.cpython-311.pyc │ ├── loss.cpython-39.pyc │ ├── modeling_vit.cpython-39.pyc │ ├── utils.cpython-311.pyc │ ├── utils.cpython-39.pyc │ ├── vse.cpython-311.pyc │ ├── vse.cpython-39.pyc │ ├── xttn.cpython-311.pyc │ └── xttn.cpython-39.pyc ├── _init_paths.py ├── cross_net.py ├── encoders.py ├── evaluation.py ├── image_caption.py ├── loss.py ├── utils.py ├── vse.py └── xttn.py ├── train.py ├── train_swin_224_coco.sh ├── train_swin_224_f30k.sh ├── train_vit_224_coco.sh ├── train_vit_224_f30k.sh ├── train_vit_384_coco.sh └── train_vit_384_f30k.sh /.gitignore: -------------------------------------------------------------------------------- 1 | runs/ 2 | wandb/ 3 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/README.md -------------------------------------------------------------------------------- /__pycache__/arguments.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/__pycache__/arguments.cpython-311.pyc -------------------------------------------------------------------------------- /__pycache__/arguments.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/__pycache__/arguments.cpython-39.pyc -------------------------------------------------------------------------------- /__pycache__/visualize.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/__pycache__/visualize.cpython-39.pyc -------------------------------------------------------------------------------- /arguments.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/arguments.py -------------------------------------------------------------------------------- /data/coco/coco_testall.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/coco/coco_testall.jsonl -------------------------------------------------------------------------------- /data/coco/coco_train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/coco/coco_train.jsonl -------------------------------------------------------------------------------- /data/coco/id_mapping.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/coco/id_mapping.json -------------------------------------------------------------------------------- /data/coco/testall_caps.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/coco/testall_caps.txt -------------------------------------------------------------------------------- /data/coco/testall_ids.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/coco/testall_ids.txt -------------------------------------------------------------------------------- /data/coco/train_caps.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/coco/train_caps.txt -------------------------------------------------------------------------------- /data/coco/train_ids.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/coco/train_ids.txt -------------------------------------------------------------------------------- /data/f30k/f30k_train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/f30k/f30k_train.jsonl -------------------------------------------------------------------------------- /data/f30k/id_mapping.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/f30k/id_mapping.json -------------------------------------------------------------------------------- /data/f30k/test_caps.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/f30k/test_caps.txt -------------------------------------------------------------------------------- /data/f30k/test_ids.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/f30k/test_ids.txt -------------------------------------------------------------------------------- /data/f30k/train_caps.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/f30k/train_caps.txt -------------------------------------------------------------------------------- /data/f30k/train_ids.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/data/f30k/train_ids.txt -------------------------------------------------------------------------------- /eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/eval.py -------------------------------------------------------------------------------- /imgs/intro.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/imgs/intro.jpg -------------------------------------------------------------------------------- /lib/__init__.py: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /lib/__pycache__/__init__.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/__init__.cpython-311.pyc -------------------------------------------------------------------------------- /lib/__pycache__/__init__.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/__init__.cpython-39.pyc -------------------------------------------------------------------------------- /lib/__pycache__/cross_net.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/cross_net.cpython-311.pyc -------------------------------------------------------------------------------- /lib/__pycache__/cross_net.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/cross_net.cpython-39.pyc -------------------------------------------------------------------------------- /lib/__pycache__/encoders.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/encoders.cpython-311.pyc -------------------------------------------------------------------------------- /lib/__pycache__/encoders.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/encoders.cpython-39.pyc -------------------------------------------------------------------------------- /lib/__pycache__/evaluation.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/evaluation.cpython-311.pyc -------------------------------------------------------------------------------- /lib/__pycache__/evaluation.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/evaluation.cpython-39.pyc -------------------------------------------------------------------------------- /lib/__pycache__/image_caption.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/image_caption.cpython-311.pyc -------------------------------------------------------------------------------- /lib/__pycache__/image_caption.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/image_caption.cpython-39.pyc -------------------------------------------------------------------------------- /lib/__pycache__/loss.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/loss.cpython-311.pyc -------------------------------------------------------------------------------- /lib/__pycache__/loss.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/loss.cpython-39.pyc -------------------------------------------------------------------------------- /lib/__pycache__/modeling_vit.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/modeling_vit.cpython-39.pyc -------------------------------------------------------------------------------- /lib/__pycache__/utils.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/utils.cpython-311.pyc -------------------------------------------------------------------------------- /lib/__pycache__/utils.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/utils.cpython-39.pyc -------------------------------------------------------------------------------- /lib/__pycache__/vse.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/vse.cpython-311.pyc -------------------------------------------------------------------------------- /lib/__pycache__/vse.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/vse.cpython-39.pyc -------------------------------------------------------------------------------- /lib/__pycache__/xttn.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/xttn.cpython-311.pyc -------------------------------------------------------------------------------- /lib/__pycache__/xttn.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/__pycache__/xttn.cpython-39.pyc -------------------------------------------------------------------------------- /lib/_init_paths.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/_init_paths.py -------------------------------------------------------------------------------- /lib/cross_net.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/cross_net.py -------------------------------------------------------------------------------- /lib/encoders.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/encoders.py -------------------------------------------------------------------------------- /lib/evaluation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/evaluation.py -------------------------------------------------------------------------------- /lib/image_caption.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/image_caption.py -------------------------------------------------------------------------------- /lib/loss.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/loss.py -------------------------------------------------------------------------------- /lib/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/utils.py -------------------------------------------------------------------------------- /lib/vse.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/vse.py -------------------------------------------------------------------------------- /lib/xttn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/lib/xttn.py -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/train.py -------------------------------------------------------------------------------- /train_swin_224_coco.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/train_swin_224_coco.sh -------------------------------------------------------------------------------- /train_swin_224_f30k.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/train_swin_224_f30k.sh -------------------------------------------------------------------------------- /train_vit_224_coco.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/train_vit_224_coco.sh -------------------------------------------------------------------------------- /train_vit_224_f30k.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/train_vit_224_f30k.sh -------------------------------------------------------------------------------- /train_vit_384_coco.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/train_vit_384_coco.sh -------------------------------------------------------------------------------- /train_vit_384_f30k.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liuyyy111/d2s-vse/HEAD/train_vit_384_f30k.sh --------------------------------------------------------------------------------