├── .gitignore ├── README.md ├── code ├── CaptionDataLoader.py ├── CaptionDataLoader2.py ├── CaptionEvaluater.py ├── CaptionGenerator.py ├── CaptionMultiDataLoader.py ├── Image2CaptionDecoder.py ├── ResNet50.py ├── ResNet50predict.py ├── ResNet_feature_extractor.py ├── __init__.py ├── compute_scores_for_Japanese.py ├── create_MSCOCO_en_jp_dataset.py ├── evaluate_captions.py ├── generate_caption.py ├── generate_caption_eval.py ├── generate_caption_table.py ├── image_loader.py ├── preprocess_Lifelog_captions.py ├── preprocess_MSCOCO_captions.py ├── preprocess_captions.py ├── preprocess_mscroro2originalformat.py └── preprocess_multilingual_MSCOCO_captions.py ├── data ├── .gitkeep ├── MSCOCO │ ├── captions_train2014_cn_translation_processed_dic.json │ ├── captions_train2014_jp_translation_processed_dic.json │ ├── mscoco_caption_train2014_processed_dic.json │ └── yjcaptions26k_clean_processed_dic.json ├── env.yml └── synset_words.txt ├── download.sh ├── experiments ├── personal_notes.txt └── personal_notes_multi.txt ├── sample.png ├── sample_code.py ├── sample_code_beam.py ├── sample_imgs ├── COCO_val2014_000000185546.jpg ├── COCO_val2014_000000192091.jpg ├── COCO_val2014_000000229948.jpg ├── COCO_val2014_000000241747.jpg ├── COCO_val2014_000000250790.jpg ├── COCO_val2014_000000277533.jpg ├── COCO_val2014_000000285505.jpg ├── COCO_val2014_000000323758.jpg ├── COCO_val2014_000000326128.jpg ├── COCO_val2014_000000397427.jpg ├── COCO_val2014_000000553761.jpg └── dog.jpg ├── train_caption_model.py ├── train_image_caption_model.py └── webapi ├── server.py ├── templates └── index.html └── uploads └── .gitkeep /.gitignore: -------------------------------------------------------------------------------- 1 | *.pyc 2 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/README.md -------------------------------------------------------------------------------- /code/CaptionDataLoader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/CaptionDataLoader.py -------------------------------------------------------------------------------- /code/CaptionDataLoader2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/CaptionDataLoader2.py -------------------------------------------------------------------------------- /code/CaptionEvaluater.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/CaptionEvaluater.py -------------------------------------------------------------------------------- /code/CaptionGenerator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/CaptionGenerator.py -------------------------------------------------------------------------------- /code/CaptionMultiDataLoader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/CaptionMultiDataLoader.py -------------------------------------------------------------------------------- /code/Image2CaptionDecoder.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/Image2CaptionDecoder.py -------------------------------------------------------------------------------- /code/ResNet50.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/ResNet50.py -------------------------------------------------------------------------------- /code/ResNet50predict.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/ResNet50predict.py -------------------------------------------------------------------------------- /code/ResNet_feature_extractor.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/ResNet_feature_extractor.py -------------------------------------------------------------------------------- /code/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /code/compute_scores_for_Japanese.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/compute_scores_for_Japanese.py -------------------------------------------------------------------------------- /code/create_MSCOCO_en_jp_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/create_MSCOCO_en_jp_dataset.py -------------------------------------------------------------------------------- /code/evaluate_captions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/evaluate_captions.py -------------------------------------------------------------------------------- /code/generate_caption.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/generate_caption.py -------------------------------------------------------------------------------- /code/generate_caption_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/generate_caption_eval.py -------------------------------------------------------------------------------- /code/generate_caption_table.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/generate_caption_table.py -------------------------------------------------------------------------------- /code/image_loader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/image_loader.py -------------------------------------------------------------------------------- /code/preprocess_Lifelog_captions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/preprocess_Lifelog_captions.py -------------------------------------------------------------------------------- /code/preprocess_MSCOCO_captions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/preprocess_MSCOCO_captions.py -------------------------------------------------------------------------------- /code/preprocess_captions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/preprocess_captions.py -------------------------------------------------------------------------------- /code/preprocess_mscroro2originalformat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/preprocess_mscroro2originalformat.py -------------------------------------------------------------------------------- /code/preprocess_multilingual_MSCOCO_captions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/code/preprocess_multilingual_MSCOCO_captions.py -------------------------------------------------------------------------------- /data/.gitkeep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /data/MSCOCO/captions_train2014_cn_translation_processed_dic.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/data/MSCOCO/captions_train2014_cn_translation_processed_dic.json -------------------------------------------------------------------------------- /data/MSCOCO/captions_train2014_jp_translation_processed_dic.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/data/MSCOCO/captions_train2014_jp_translation_processed_dic.json -------------------------------------------------------------------------------- /data/MSCOCO/mscoco_caption_train2014_processed_dic.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/data/MSCOCO/mscoco_caption_train2014_processed_dic.json -------------------------------------------------------------------------------- /data/MSCOCO/yjcaptions26k_clean_processed_dic.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/data/MSCOCO/yjcaptions26k_clean_processed_dic.json -------------------------------------------------------------------------------- /data/env.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/data/env.yml -------------------------------------------------------------------------------- /data/synset_words.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/data/synset_words.txt -------------------------------------------------------------------------------- /download.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/download.sh -------------------------------------------------------------------------------- /experiments/personal_notes.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/experiments/personal_notes.txt -------------------------------------------------------------------------------- /experiments/personal_notes_multi.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/experiments/personal_notes_multi.txt -------------------------------------------------------------------------------- /sample.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample.png -------------------------------------------------------------------------------- /sample_code.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_code.py -------------------------------------------------------------------------------- /sample_code_beam.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_code_beam.py -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000185546.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000185546.jpg -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000192091.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000192091.jpg -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000229948.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000229948.jpg -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000241747.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000241747.jpg -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000250790.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000250790.jpg -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000277533.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000277533.jpg -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000285505.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000285505.jpg -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000323758.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000323758.jpg -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000326128.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000326128.jpg -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000397427.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000397427.jpg -------------------------------------------------------------------------------- /sample_imgs/COCO_val2014_000000553761.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/COCO_val2014_000000553761.jpg -------------------------------------------------------------------------------- /sample_imgs/dog.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/sample_imgs/dog.jpg -------------------------------------------------------------------------------- /train_caption_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/train_caption_model.py -------------------------------------------------------------------------------- /train_image_caption_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/train_image_caption_model.py -------------------------------------------------------------------------------- /webapi/server.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/webapi/server.py -------------------------------------------------------------------------------- /webapi/templates/index.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/apple2373/chainer-caption/HEAD/webapi/templates/index.html -------------------------------------------------------------------------------- /webapi/uploads/.gitkeep: -------------------------------------------------------------------------------- 1 | --------------------------------------------------------------------------------