├── .gitignore ├── LICENSE ├── README.md ├── data └── bpe_simple_vocab_16e6.txt.gz ├── dataloader ├── data_config.yaml ├── data_loaders.py └── dataset.py ├── demo_output ├── demo.png └── single_img_demo.png ├── figures ├── demo.png ├── img_text_sim.png └── img_text_sim_coco_val.png ├── model ├── model.py └── model_config.yaml ├── requirements.txt ├── test_images ├── bicycle.jpeg ├── bus.jpg ├── camel.jpg ├── castle.jpeg ├── crab.jpeg ├── forest.jpg ├── lamp.jpeg ├── motorcycle.jpg ├── orange.jpg ├── palm_tree.jpg ├── squirrel.jpg └── tractor.jpeg ├── train.py ├── trainer └── train_config.yaml ├── utils ├── __init__.py ├── custom_schedulers.py ├── logger.py ├── simple_tokenizer.py └── util.py ├── zero_shot ├── WordNetId2ClassName.txt └── class_names_and_templates.py ├── zero_shot_demo.py ├── zero_shot_eval_output ├── CIFAR10.txt ├── CIFAR100.txt ├── Imagenet-sketch.txt ├── coco_trained_clip_observations.md ├── imagenet-a.txt ├── imagenet-r.txt ├── imagenet_val.txt └── imagenetv2-matched-frequency-format-val.txt └── zeroshot_eval.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/README.md -------------------------------------------------------------------------------- /data/bpe_simple_vocab_16e6.txt.gz: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/data/bpe_simple_vocab_16e6.txt.gz -------------------------------------------------------------------------------- /dataloader/data_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/dataloader/data_config.yaml -------------------------------------------------------------------------------- /dataloader/data_loaders.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/dataloader/data_loaders.py -------------------------------------------------------------------------------- /dataloader/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/dataloader/dataset.py -------------------------------------------------------------------------------- /demo_output/demo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/demo_output/demo.png -------------------------------------------------------------------------------- /demo_output/single_img_demo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/demo_output/single_img_demo.png -------------------------------------------------------------------------------- /figures/demo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/figures/demo.png -------------------------------------------------------------------------------- /figures/img_text_sim.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/figures/img_text_sim.png -------------------------------------------------------------------------------- /figures/img_text_sim_coco_val.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/figures/img_text_sim_coco_val.png -------------------------------------------------------------------------------- /model/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/model/model.py -------------------------------------------------------------------------------- /model/model_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/model/model_config.yaml -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/requirements.txt -------------------------------------------------------------------------------- /test_images/bicycle.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/bicycle.jpeg -------------------------------------------------------------------------------- /test_images/bus.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/bus.jpg -------------------------------------------------------------------------------- /test_images/camel.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/camel.jpg -------------------------------------------------------------------------------- /test_images/castle.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/castle.jpeg -------------------------------------------------------------------------------- /test_images/crab.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/crab.jpeg -------------------------------------------------------------------------------- /test_images/forest.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/forest.jpg -------------------------------------------------------------------------------- /test_images/lamp.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/lamp.jpeg -------------------------------------------------------------------------------- /test_images/motorcycle.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/motorcycle.jpg -------------------------------------------------------------------------------- /test_images/orange.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/orange.jpg -------------------------------------------------------------------------------- /test_images/palm_tree.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/palm_tree.jpg -------------------------------------------------------------------------------- /test_images/squirrel.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/squirrel.jpg -------------------------------------------------------------------------------- /test_images/tractor.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/test_images/tractor.jpeg -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/train.py -------------------------------------------------------------------------------- /trainer/train_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/trainer/train_config.yaml -------------------------------------------------------------------------------- /utils/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/utils/__init__.py -------------------------------------------------------------------------------- /utils/custom_schedulers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/utils/custom_schedulers.py -------------------------------------------------------------------------------- /utils/logger.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/utils/logger.py -------------------------------------------------------------------------------- /utils/simple_tokenizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/utils/simple_tokenizer.py -------------------------------------------------------------------------------- /utils/util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/utils/util.py -------------------------------------------------------------------------------- /zero_shot/WordNetId2ClassName.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot/WordNetId2ClassName.txt -------------------------------------------------------------------------------- /zero_shot/class_names_and_templates.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot/class_names_and_templates.py -------------------------------------------------------------------------------- /zero_shot_demo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot_demo.py -------------------------------------------------------------------------------- /zero_shot_eval_output/CIFAR10.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot_eval_output/CIFAR10.txt -------------------------------------------------------------------------------- /zero_shot_eval_output/CIFAR100.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot_eval_output/CIFAR100.txt -------------------------------------------------------------------------------- /zero_shot_eval_output/Imagenet-sketch.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot_eval_output/Imagenet-sketch.txt -------------------------------------------------------------------------------- /zero_shot_eval_output/coco_trained_clip_observations.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot_eval_output/coco_trained_clip_observations.md -------------------------------------------------------------------------------- /zero_shot_eval_output/imagenet-a.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot_eval_output/imagenet-a.txt -------------------------------------------------------------------------------- /zero_shot_eval_output/imagenet-r.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot_eval_output/imagenet-r.txt -------------------------------------------------------------------------------- /zero_shot_eval_output/imagenet_val.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot_eval_output/imagenet_val.txt -------------------------------------------------------------------------------- /zero_shot_eval_output/imagenetv2-matched-frequency-format-val.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zero_shot_eval_output/imagenetv2-matched-frequency-format-val.txt -------------------------------------------------------------------------------- /zeroshot_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/revantteotia/clip-training/HEAD/zeroshot_eval.py --------------------------------------------------------------------------------