├── .gitignore ├── CONTRIBUTING.md ├── LICENSE ├── README.md ├── docs └── images │ ├── block_diagram.png │ ├── overview.png │ └── qualitative.png ├── pytorch ├── TIPS_Demo.ipynb ├── __init__.py ├── checkpoints │ └── download_checkpoints.sh ├── image_encoder.py ├── run_image_encoder_inference.py ├── run_text_encoder_inference.py └── text_encoder.py └── scenic ├── checkpoints └── download_checkpoints.sh ├── configs └── tips_model_config.py ├── images ├── example_image.jpg └── example_image_2.jpg ├── models ├── text.py ├── tips.py └── vit.py ├── notebooks └── TIPS_Demo.ipynb ├── run_tips_inference.py └── utils ├── checkpoint.py └── feature_viz.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/.gitignore -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/CONTRIBUTING.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/README.md -------------------------------------------------------------------------------- /docs/images/block_diagram.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/docs/images/block_diagram.png -------------------------------------------------------------------------------- /docs/images/overview.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/docs/images/overview.png -------------------------------------------------------------------------------- /docs/images/qualitative.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/docs/images/qualitative.png -------------------------------------------------------------------------------- /pytorch/TIPS_Demo.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/pytorch/TIPS_Demo.ipynb -------------------------------------------------------------------------------- /pytorch/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/pytorch/__init__.py -------------------------------------------------------------------------------- /pytorch/checkpoints/download_checkpoints.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/pytorch/checkpoints/download_checkpoints.sh -------------------------------------------------------------------------------- /pytorch/image_encoder.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/pytorch/image_encoder.py -------------------------------------------------------------------------------- /pytorch/run_image_encoder_inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/pytorch/run_image_encoder_inference.py -------------------------------------------------------------------------------- /pytorch/run_text_encoder_inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/pytorch/run_text_encoder_inference.py -------------------------------------------------------------------------------- /pytorch/text_encoder.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/pytorch/text_encoder.py -------------------------------------------------------------------------------- /scenic/checkpoints/download_checkpoints.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/checkpoints/download_checkpoints.sh -------------------------------------------------------------------------------- /scenic/configs/tips_model_config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/configs/tips_model_config.py -------------------------------------------------------------------------------- /scenic/images/example_image.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/images/example_image.jpg -------------------------------------------------------------------------------- /scenic/images/example_image_2.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/images/example_image_2.jpg -------------------------------------------------------------------------------- /scenic/models/text.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/models/text.py -------------------------------------------------------------------------------- /scenic/models/tips.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/models/tips.py -------------------------------------------------------------------------------- /scenic/models/vit.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/models/vit.py -------------------------------------------------------------------------------- /scenic/notebooks/TIPS_Demo.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/notebooks/TIPS_Demo.ipynb -------------------------------------------------------------------------------- /scenic/run_tips_inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/run_tips_inference.py -------------------------------------------------------------------------------- /scenic/utils/checkpoint.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/utils/checkpoint.py -------------------------------------------------------------------------------- /scenic/utils/feature_viz.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-deepmind/tips/HEAD/scenic/utils/feature_viz.py --------------------------------------------------------------------------------