├── .gitignore ├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── LICENSE ├── README.md ├── assets ├── avocado_toast.jpg ├── meru_model.jpg ├── new_york.jpg ├── pexels_text.json ├── sydney_opera.jpg ├── taj_mahal.jpg └── traversals_preview.jpg ├── configs ├── eval_linprobe_classification.py ├── eval_zero_shot_classification.py ├── eval_zero_shot_retrieval.py ├── train_clip_vit_b.py ├── train_clip_vit_l.py ├── train_clip_vit_s.py ├── train_meru_vit_b.py ├── train_meru_vit_l.py └── train_meru_vit_s.py ├── meru ├── bpe_simple_vocab_16e6.txt.gz ├── config.py ├── data │ ├── evaluation.py │ └── redcaps.py ├── encoders │ ├── image_encoders.py │ └── text_encoders.py ├── evaluation │ ├── catalog.py │ ├── class_names.py │ ├── classification.py │ └── retrieval.py ├── lorentz.py ├── models.py ├── optim.py ├── tokenizer.py └── utils │ ├── checkpointing.py │ ├── distributed.py │ └── timer.py ├── requirements.txt ├── scripts ├── evaluate.py ├── image_traversals.py └── train.py └── setup.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/.gitignore -------------------------------------------------------------------------------- /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/CONTRIBUTING.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/README.md -------------------------------------------------------------------------------- /assets/avocado_toast.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/assets/avocado_toast.jpg -------------------------------------------------------------------------------- /assets/meru_model.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/assets/meru_model.jpg -------------------------------------------------------------------------------- /assets/new_york.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/assets/new_york.jpg -------------------------------------------------------------------------------- /assets/pexels_text.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/assets/pexels_text.json -------------------------------------------------------------------------------- /assets/sydney_opera.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/assets/sydney_opera.jpg -------------------------------------------------------------------------------- /assets/taj_mahal.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/assets/taj_mahal.jpg -------------------------------------------------------------------------------- /assets/traversals_preview.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/assets/traversals_preview.jpg -------------------------------------------------------------------------------- /configs/eval_linprobe_classification.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/configs/eval_linprobe_classification.py -------------------------------------------------------------------------------- /configs/eval_zero_shot_classification.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/configs/eval_zero_shot_classification.py -------------------------------------------------------------------------------- /configs/eval_zero_shot_retrieval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/configs/eval_zero_shot_retrieval.py -------------------------------------------------------------------------------- /configs/train_clip_vit_b.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/configs/train_clip_vit_b.py -------------------------------------------------------------------------------- /configs/train_clip_vit_l.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/configs/train_clip_vit_l.py -------------------------------------------------------------------------------- /configs/train_clip_vit_s.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/configs/train_clip_vit_s.py -------------------------------------------------------------------------------- /configs/train_meru_vit_b.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/configs/train_meru_vit_b.py -------------------------------------------------------------------------------- /configs/train_meru_vit_l.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/configs/train_meru_vit_l.py -------------------------------------------------------------------------------- /configs/train_meru_vit_s.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/configs/train_meru_vit_s.py -------------------------------------------------------------------------------- /meru/bpe_simple_vocab_16e6.txt.gz: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/bpe_simple_vocab_16e6.txt.gz -------------------------------------------------------------------------------- /meru/config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/config.py -------------------------------------------------------------------------------- /meru/data/evaluation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/data/evaluation.py -------------------------------------------------------------------------------- /meru/data/redcaps.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/data/redcaps.py -------------------------------------------------------------------------------- /meru/encoders/image_encoders.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/encoders/image_encoders.py -------------------------------------------------------------------------------- /meru/encoders/text_encoders.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/encoders/text_encoders.py -------------------------------------------------------------------------------- /meru/evaluation/catalog.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/evaluation/catalog.py -------------------------------------------------------------------------------- /meru/evaluation/class_names.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/evaluation/class_names.py -------------------------------------------------------------------------------- /meru/evaluation/classification.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/evaluation/classification.py -------------------------------------------------------------------------------- /meru/evaluation/retrieval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/evaluation/retrieval.py -------------------------------------------------------------------------------- /meru/lorentz.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/lorentz.py -------------------------------------------------------------------------------- /meru/models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/models.py -------------------------------------------------------------------------------- /meru/optim.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/optim.py -------------------------------------------------------------------------------- /meru/tokenizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/tokenizer.py -------------------------------------------------------------------------------- /meru/utils/checkpointing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/utils/checkpointing.py -------------------------------------------------------------------------------- /meru/utils/distributed.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/utils/distributed.py -------------------------------------------------------------------------------- /meru/utils/timer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/meru/utils/timer.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/requirements.txt -------------------------------------------------------------------------------- /scripts/evaluate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/scripts/evaluate.py -------------------------------------------------------------------------------- /scripts/image_traversals.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/scripts/image_traversals.py -------------------------------------------------------------------------------- /scripts/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/scripts/train.py -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/meru/HEAD/setup.py --------------------------------------------------------------------------------