├── README.md ├── blocks ├── __init__.py ├── feedforward_block.py └── lowrank_bilinear_block.py ├── datasets ├── __init__.py ├── coco_dataset.py └── data_loader.py ├── evaluation ├── __init__.py ├── coco_evaler.py └── evaler.py ├── experiments ├── xlan │ ├── config.yml │ └── train.sh ├── xlan_rl │ ├── config.yml │ └── train.sh ├── xtransformer │ ├── config.yml │ └── train.sh └── xtransformer_rl │ ├── config.yml │ └── train.sh ├── images └── framework.jpg ├── layers ├── __init__.py ├── attention.py ├── basic_att.py ├── low_rank.py ├── positional_encoding.py └── sc_att.py ├── lib ├── config.py └── utils.py ├── losses ├── __init__.py ├── cross_entropy.py ├── label_smoothing.py └── reward_criterion.py ├── lr_scheduler ├── __init__.py ├── multi_step_lr.py └── noam_lr.py ├── main.py ├── main_test.py ├── models ├── __init__.py ├── att_basic_model.py ├── basic_model.py ├── updown.py ├── xlan.py └── xtransformer.py ├── optimizer ├── __init__.py ├── optimizer.py └── radam.py ├── samplers ├── __init__.py └── distributed.py ├── scorer ├── __init__.py ├── cider.py ├── cider_scorer.py └── scorer.py └── tools ├── cider_cache.py ├── create_feats.py └── create_labels.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/README.md -------------------------------------------------------------------------------- /blocks/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/blocks/__init__.py -------------------------------------------------------------------------------- /blocks/feedforward_block.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/blocks/feedforward_block.py -------------------------------------------------------------------------------- /blocks/lowrank_bilinear_block.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/blocks/lowrank_bilinear_block.py -------------------------------------------------------------------------------- /datasets/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /datasets/coco_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/datasets/coco_dataset.py -------------------------------------------------------------------------------- /datasets/data_loader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/datasets/data_loader.py -------------------------------------------------------------------------------- /evaluation/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/evaluation/__init__.py -------------------------------------------------------------------------------- /evaluation/coco_evaler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/evaluation/coco_evaler.py -------------------------------------------------------------------------------- /evaluation/evaler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/evaluation/evaler.py -------------------------------------------------------------------------------- /experiments/xlan/config.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/experiments/xlan/config.yml -------------------------------------------------------------------------------- /experiments/xlan/train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/experiments/xlan/train.sh -------------------------------------------------------------------------------- /experiments/xlan_rl/config.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/experiments/xlan_rl/config.yml -------------------------------------------------------------------------------- /experiments/xlan_rl/train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/experiments/xlan_rl/train.sh -------------------------------------------------------------------------------- /experiments/xtransformer/config.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/experiments/xtransformer/config.yml -------------------------------------------------------------------------------- /experiments/xtransformer/train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/experiments/xtransformer/train.sh -------------------------------------------------------------------------------- /experiments/xtransformer_rl/config.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/experiments/xtransformer_rl/config.yml -------------------------------------------------------------------------------- /experiments/xtransformer_rl/train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/experiments/xtransformer_rl/train.sh -------------------------------------------------------------------------------- /images/framework.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/images/framework.jpg -------------------------------------------------------------------------------- /layers/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/layers/__init__.py -------------------------------------------------------------------------------- /layers/attention.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/layers/attention.py -------------------------------------------------------------------------------- /layers/basic_att.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/layers/basic_att.py -------------------------------------------------------------------------------- /layers/low_rank.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/layers/low_rank.py -------------------------------------------------------------------------------- /layers/positional_encoding.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/layers/positional_encoding.py -------------------------------------------------------------------------------- /layers/sc_att.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/layers/sc_att.py -------------------------------------------------------------------------------- /lib/config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/lib/config.py -------------------------------------------------------------------------------- /lib/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/lib/utils.py -------------------------------------------------------------------------------- /losses/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/losses/__init__.py -------------------------------------------------------------------------------- /losses/cross_entropy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/losses/cross_entropy.py -------------------------------------------------------------------------------- /losses/label_smoothing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/losses/label_smoothing.py -------------------------------------------------------------------------------- /losses/reward_criterion.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/losses/reward_criterion.py -------------------------------------------------------------------------------- /lr_scheduler/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/lr_scheduler/__init__.py -------------------------------------------------------------------------------- /lr_scheduler/multi_step_lr.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/lr_scheduler/multi_step_lr.py -------------------------------------------------------------------------------- /lr_scheduler/noam_lr.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/lr_scheduler/noam_lr.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/main.py -------------------------------------------------------------------------------- /main_test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/main_test.py -------------------------------------------------------------------------------- /models/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/models/__init__.py -------------------------------------------------------------------------------- /models/att_basic_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/models/att_basic_model.py -------------------------------------------------------------------------------- /models/basic_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/models/basic_model.py -------------------------------------------------------------------------------- /models/updown.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/models/updown.py -------------------------------------------------------------------------------- /models/xlan.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/models/xlan.py -------------------------------------------------------------------------------- /models/xtransformer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/models/xtransformer.py -------------------------------------------------------------------------------- /optimizer/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /optimizer/optimizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/optimizer/optimizer.py -------------------------------------------------------------------------------- /optimizer/radam.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/optimizer/radam.py -------------------------------------------------------------------------------- /samplers/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /samplers/distributed.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/samplers/distributed.py -------------------------------------------------------------------------------- /scorer/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /scorer/cider.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/scorer/cider.py -------------------------------------------------------------------------------- /scorer/cider_scorer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/scorer/cider_scorer.py -------------------------------------------------------------------------------- /scorer/scorer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/scorer/scorer.py -------------------------------------------------------------------------------- /tools/cider_cache.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/tools/cider_cache.py -------------------------------------------------------------------------------- /tools/create_feats.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/tools/create_feats.py -------------------------------------------------------------------------------- /tools/create_labels.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JDAI-CV/image-captioning/HEAD/tools/create_labels.py --------------------------------------------------------------------------------