├── .gitignore ├── LICENSE ├── README.md ├── XCLIP.png ├── dataloaders ├── data_dataloaders.py ├── dataloader_activitynet_retrieval.py ├── dataloader_didemo_retrieval.py ├── dataloader_lsmdc_retrieval.py ├── dataloader_msrvtt_retrieval.py ├── dataloader_msvd_retrieval.py └── rawvideo_util.py ├── main_clip4clip.py ├── main_xclip.py ├── metrics.py ├── modules ├── __init__.py ├── bpe_simple_vocab_16e6.txt.gz ├── cross-base │ └── cross_config.json ├── file_utils.py ├── modeling.py ├── modeling_xclip.py ├── module_clip.py ├── module_cross.py ├── optimization.py ├── tokenization_clip.py ├── until_config.py └── until_module.py ├── preprocess └── compress_video.py ├── requirements.txt ├── scripts ├── run_xclip_actnet_vit16.sh ├── run_xclip_actnet_vit32.sh ├── run_xclip_didemo_vit16.sh ├── run_xclip_didemo_vit32.sh ├── run_xclip_lsmdc_vit16.sh ├── run_xclip_lsmdc_vit32.sh ├── run_xclip_msrvtt_vit16.sh ├── run_xclip_msrvtt_vit32.sh ├── run_xclip_msvd_vit16.sh └── run_xclip_msvd_vit32.sh └── util.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/README.md -------------------------------------------------------------------------------- /XCLIP.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/XCLIP.png -------------------------------------------------------------------------------- /dataloaders/data_dataloaders.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/dataloaders/data_dataloaders.py -------------------------------------------------------------------------------- /dataloaders/dataloader_activitynet_retrieval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/dataloaders/dataloader_activitynet_retrieval.py -------------------------------------------------------------------------------- /dataloaders/dataloader_didemo_retrieval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/dataloaders/dataloader_didemo_retrieval.py -------------------------------------------------------------------------------- /dataloaders/dataloader_lsmdc_retrieval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/dataloaders/dataloader_lsmdc_retrieval.py -------------------------------------------------------------------------------- /dataloaders/dataloader_msrvtt_retrieval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/dataloaders/dataloader_msrvtt_retrieval.py -------------------------------------------------------------------------------- /dataloaders/dataloader_msvd_retrieval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/dataloaders/dataloader_msvd_retrieval.py -------------------------------------------------------------------------------- /dataloaders/rawvideo_util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/dataloaders/rawvideo_util.py -------------------------------------------------------------------------------- /main_clip4clip.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/main_clip4clip.py -------------------------------------------------------------------------------- /main_xclip.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/main_xclip.py -------------------------------------------------------------------------------- /metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/metrics.py -------------------------------------------------------------------------------- /modules/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /modules/bpe_simple_vocab_16e6.txt.gz: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/bpe_simple_vocab_16e6.txt.gz -------------------------------------------------------------------------------- /modules/cross-base/cross_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/cross-base/cross_config.json -------------------------------------------------------------------------------- /modules/file_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/file_utils.py -------------------------------------------------------------------------------- /modules/modeling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/modeling.py -------------------------------------------------------------------------------- /modules/modeling_xclip.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/modeling_xclip.py -------------------------------------------------------------------------------- /modules/module_clip.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/module_clip.py -------------------------------------------------------------------------------- /modules/module_cross.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/module_cross.py -------------------------------------------------------------------------------- /modules/optimization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/optimization.py -------------------------------------------------------------------------------- /modules/tokenization_clip.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/tokenization_clip.py -------------------------------------------------------------------------------- /modules/until_config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/until_config.py -------------------------------------------------------------------------------- /modules/until_module.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/modules/until_module.py -------------------------------------------------------------------------------- /preprocess/compress_video.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/preprocess/compress_video.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | ftfy 2 | regex 3 | tqdm 4 | opencv-python 5 | boto3 6 | requests 7 | pandas -------------------------------------------------------------------------------- /scripts/run_xclip_actnet_vit16.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/scripts/run_xclip_actnet_vit16.sh -------------------------------------------------------------------------------- /scripts/run_xclip_actnet_vit32.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/scripts/run_xclip_actnet_vit32.sh -------------------------------------------------------------------------------- /scripts/run_xclip_didemo_vit16.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/scripts/run_xclip_didemo_vit16.sh -------------------------------------------------------------------------------- /scripts/run_xclip_didemo_vit32.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/scripts/run_xclip_didemo_vit32.sh -------------------------------------------------------------------------------- /scripts/run_xclip_lsmdc_vit16.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/scripts/run_xclip_lsmdc_vit16.sh -------------------------------------------------------------------------------- /scripts/run_xclip_lsmdc_vit32.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/scripts/run_xclip_lsmdc_vit32.sh -------------------------------------------------------------------------------- /scripts/run_xclip_msrvtt_vit16.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/scripts/run_xclip_msrvtt_vit16.sh -------------------------------------------------------------------------------- /scripts/run_xclip_msrvtt_vit32.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/scripts/run_xclip_msrvtt_vit32.sh -------------------------------------------------------------------------------- /scripts/run_xclip_msvd_vit16.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/scripts/run_xclip_msvd_vit16.sh -------------------------------------------------------------------------------- /scripts/run_xclip_msvd_vit32.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/scripts/run_xclip_msvd_vit32.sh -------------------------------------------------------------------------------- /util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xuguohai/X-CLIP/HEAD/util.py --------------------------------------------------------------------------------