├── .gitignore ├── LICENSE ├── README.md ├── Retrieval.ipynb ├── Seperating Hyperplane Projected Distance.ipynb ├── UMAP.ipynb ├── cloob_compute_coco_embeddings.py ├── cloob_compute_embeddings.py ├── figures ├── CLIP_big_PCA.png ├── CLIP_big_laion_PCA.png ├── CLIP_small_infoLOOB_PCA.png ├── CLIP_small_infoNCE_PCA.png ├── CLOOB_big_PCA.png ├── CLOOB_big_laion_PCA.png ├── CLOOB_small_infoLOOB_PCA.png ├── CLOOB_small_infoNCE_PCA.png ├── UMAP_CLIP_big.png ├── UMAP_CLIP_big_laion.png ├── UMAP_CLIP_small_infoLOOB.png ├── UMAP_CLIP_small_infoNCE.png ├── UMAP_CLOOB_big.png ├── UMAP_CLOOB_big_laion.png ├── UMAP_CLOOB_small_infoLOOB.png ├── UMAP_CLOOB_small_infoNCE.png ├── UMAP_ablations_CLIP_big.png ├── UMAP_ablations_CLIP_big_laion.png ├── UMAP_ablations_CLIP_small_infoLOOB.png ├── UMAP_ablations_CLIP_small_infoNCE.png ├── UMAP_ablations_CLOOB_big.png ├── UMAP_ablations_CLOOB_big_laion.png ├── UMAP_ablations_CLOOB_small_infoLOOB.png ├── UMAP_ablations_CLOOB_small_infoNCE.png ├── UMAP_ablations_cloob ViT-B-16.png ├── UMAP_ablations_openclip ViT-B-16.png ├── UMAP_cloob ViT-B-16.png ├── UMAP_lines_cloob ViT-B-16.png ├── UMAP_lines_ml_jku_clip_infoLOOB.png ├── UMAP_lines_ml_jku_clip_infoLOOB_vs_ml_jku_cloob_infoNCE.png ├── UMAP_lines_ml_jku_clip_rn50.png ├── UMAP_lines_ml_jku_clip_rn50_vs_ml_jku_cloob_rn50.png ├── UMAP_lines_ml_jku_cloob_infoNCE.png ├── UMAP_lines_ml_jku_cloob_rn50.png ├── UMAP_lines_openclip ViT-B-16.png ├── UMAP_lines_openclip ViT-B-16_vs_cloob ViT-B-16.png ├── UMAP_ml_jku_clip_infoLOOB.png ├── UMAP_ml_jku_clip_infoLOOB_vs_ml_jku_cloob_infoNCE.png ├── UMAP_ml_jku_clip_rn50.png ├── UMAP_ml_jku_clip_rn50_vs_ml_jku_cloob_rn50.png ├── UMAP_ml_jku_cloob_infoNCE.png ├── UMAP_ml_jku_cloob_rn50.png ├── UMAP_openclip ViT-B-16.png ├── UMAP_openclip ViT-B-16_vs_cloob ViT-B-16.png ├── UMAP_sphere_CLIP_big.png ├── UMAP_sphere_CLIP_big_laion.png ├── UMAP_sphere_CLIP_small_infoLOOB.png ├── UMAP_sphere_CLIP_small_infoNCE.png ├── UMAP_sphere_CLOOB_big.png ├── UMAP_sphere_CLOOB_big_laion.png ├── UMAP_sphere_CLOOB_small_infoLOOB.png ├── UMAP_sphere_CLOOB_small_infoNCE.png ├── UMAP_sphere_ablations_CLIP_big.png ├── UMAP_sphere_ablations_CLIP_big_laion.png ├── UMAP_sphere_ablations_CLIP_small_infoNCE.png ├── UMAP_sphere_ablations_CLOOB_big.png ├── UMAP_sphere_ablations_CLOOB_big_laion.png ├── cloob ViT-B-16_PCA.png ├── hyperplane_after_CLIP_big.png ├── hyperplane_after_CLIP_big_laion.png ├── hyperplane_after_CLIP_small_infoLOOB.png ├── hyperplane_after_CLIP_small_infoNCE.png ├── hyperplane_after_CLOOB_big.png ├── hyperplane_after_CLOOB_big_laion.png ├── hyperplane_after_CLOOB_small_infoLOOB.png ├── hyperplane_after_CLOOB_small_infoNCE.png ├── hyperplane_before_CLIP_big.png ├── hyperplane_before_CLIP_big_laion.png ├── hyperplane_before_CLIP_small_infoLOOB.png ├── hyperplane_before_CLIP_small_infoNCE.png ├── hyperplane_before_CLOOB_big.png ├── hyperplane_before_CLOOB_big_laion.png ├── hyperplane_before_CLOOB_small_infoLOOB.png ├── hyperplane_before_CLOOB_small_infoNCE.png ├── hyperplane_clustered_before_CLIP_big.png ├── hyperplane_clustered_before_CLIP_big_laion.png ├── hyperplane_clustered_before_CLIP_small_infoLOOB.png ├── hyperplane_clustered_before_CLIP_small_infoNCE.png ├── hyperplane_clustered_before_CLOOB_big.png ├── hyperplane_clustered_before_CLOOB_big_laion.png ├── hyperplane_clustered_before_CLOOB_small_infoLOOB.png ├── hyperplane_clustered_before_CLOOB_small_infoNCE.png ├── hyperplane_clusterede_after_CLIP_big.png ├── hyperplane_clusterede_after_CLIP_big_laion.png ├── hyperplane_clusterede_after_CLIP_small_infoLOOB.png ├── hyperplane_clusterede_after_CLIP_small_infoNCE.png ├── hyperplane_clusterede_after_CLOOB_big.png ├── hyperplane_clusterede_after_CLOOB_big_laion.png ├── hyperplane_clusterede_after_CLOOB_small_infoLOOB.png ├── hyperplane_clusterede_after_CLOOB_small_infoNCE.png ├── img->text retrieval @1.png ├── img->text retrieval @5.png ├── ml_jku_clip_infoLOOB_PCA.png ├── ml_jku_clip_rn50_PCA.png ├── ml_jku_cloob_infoNCE_PCA.png ├── ml_jku_cloob_rn50_PCA.png ├── openclip ViT-B-16_PCA.png ├── text->img retrieval @1.png └── text->img retrieval @5.png ├── requirements.txt └── svm_analysis.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/README.md -------------------------------------------------------------------------------- /Retrieval.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/Retrieval.ipynb -------------------------------------------------------------------------------- /Seperating Hyperplane Projected Distance.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/Seperating Hyperplane Projected Distance.ipynb -------------------------------------------------------------------------------- /UMAP.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/UMAP.ipynb -------------------------------------------------------------------------------- /cloob_compute_coco_embeddings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/cloob_compute_coco_embeddings.py -------------------------------------------------------------------------------- /cloob_compute_embeddings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/cloob_compute_embeddings.py -------------------------------------------------------------------------------- /figures/CLIP_big_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/CLIP_big_PCA.png -------------------------------------------------------------------------------- /figures/CLIP_big_laion_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/CLIP_big_laion_PCA.png -------------------------------------------------------------------------------- /figures/CLIP_small_infoLOOB_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/CLIP_small_infoLOOB_PCA.png -------------------------------------------------------------------------------- /figures/CLIP_small_infoNCE_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/CLIP_small_infoNCE_PCA.png -------------------------------------------------------------------------------- /figures/CLOOB_big_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/CLOOB_big_PCA.png -------------------------------------------------------------------------------- /figures/CLOOB_big_laion_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/CLOOB_big_laion_PCA.png -------------------------------------------------------------------------------- /figures/CLOOB_small_infoLOOB_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/CLOOB_small_infoLOOB_PCA.png -------------------------------------------------------------------------------- /figures/CLOOB_small_infoNCE_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/CLOOB_small_infoNCE_PCA.png -------------------------------------------------------------------------------- /figures/UMAP_CLIP_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_CLIP_big.png -------------------------------------------------------------------------------- /figures/UMAP_CLIP_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_CLIP_big_laion.png -------------------------------------------------------------------------------- /figures/UMAP_CLIP_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_CLIP_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/UMAP_CLIP_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_CLIP_small_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_CLOOB_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_CLOOB_big.png -------------------------------------------------------------------------------- /figures/UMAP_CLOOB_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_CLOOB_big_laion.png -------------------------------------------------------------------------------- /figures/UMAP_CLOOB_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_CLOOB_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/UMAP_CLOOB_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_CLOOB_small_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_ablations_CLIP_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ablations_CLIP_big.png -------------------------------------------------------------------------------- /figures/UMAP_ablations_CLIP_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ablations_CLIP_big_laion.png -------------------------------------------------------------------------------- /figures/UMAP_ablations_CLIP_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ablations_CLIP_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/UMAP_ablations_CLIP_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ablations_CLIP_small_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_ablations_CLOOB_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ablations_CLOOB_big.png -------------------------------------------------------------------------------- /figures/UMAP_ablations_CLOOB_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ablations_CLOOB_big_laion.png -------------------------------------------------------------------------------- /figures/UMAP_ablations_CLOOB_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ablations_CLOOB_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/UMAP_ablations_CLOOB_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ablations_CLOOB_small_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_ablations_cloob ViT-B-16.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ablations_cloob ViT-B-16.png -------------------------------------------------------------------------------- /figures/UMAP_ablations_openclip ViT-B-16.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ablations_openclip ViT-B-16.png -------------------------------------------------------------------------------- /figures/UMAP_cloob ViT-B-16.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_cloob ViT-B-16.png -------------------------------------------------------------------------------- /figures/UMAP_lines_cloob ViT-B-16.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_lines_cloob ViT-B-16.png -------------------------------------------------------------------------------- /figures/UMAP_lines_ml_jku_clip_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_lines_ml_jku_clip_infoLOOB.png -------------------------------------------------------------------------------- /figures/UMAP_lines_ml_jku_clip_infoLOOB_vs_ml_jku_cloob_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_lines_ml_jku_clip_infoLOOB_vs_ml_jku_cloob_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_lines_ml_jku_clip_rn50.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_lines_ml_jku_clip_rn50.png -------------------------------------------------------------------------------- /figures/UMAP_lines_ml_jku_clip_rn50_vs_ml_jku_cloob_rn50.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_lines_ml_jku_clip_rn50_vs_ml_jku_cloob_rn50.png -------------------------------------------------------------------------------- /figures/UMAP_lines_ml_jku_cloob_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_lines_ml_jku_cloob_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_lines_ml_jku_cloob_rn50.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_lines_ml_jku_cloob_rn50.png -------------------------------------------------------------------------------- /figures/UMAP_lines_openclip ViT-B-16.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_lines_openclip ViT-B-16.png -------------------------------------------------------------------------------- /figures/UMAP_lines_openclip ViT-B-16_vs_cloob ViT-B-16.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_lines_openclip ViT-B-16_vs_cloob ViT-B-16.png -------------------------------------------------------------------------------- /figures/UMAP_ml_jku_clip_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ml_jku_clip_infoLOOB.png -------------------------------------------------------------------------------- /figures/UMAP_ml_jku_clip_infoLOOB_vs_ml_jku_cloob_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ml_jku_clip_infoLOOB_vs_ml_jku_cloob_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_ml_jku_clip_rn50.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ml_jku_clip_rn50.png -------------------------------------------------------------------------------- /figures/UMAP_ml_jku_clip_rn50_vs_ml_jku_cloob_rn50.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ml_jku_clip_rn50_vs_ml_jku_cloob_rn50.png -------------------------------------------------------------------------------- /figures/UMAP_ml_jku_cloob_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ml_jku_cloob_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_ml_jku_cloob_rn50.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_ml_jku_cloob_rn50.png -------------------------------------------------------------------------------- /figures/UMAP_openclip ViT-B-16.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_openclip ViT-B-16.png -------------------------------------------------------------------------------- /figures/UMAP_openclip ViT-B-16_vs_cloob ViT-B-16.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_openclip ViT-B-16_vs_cloob ViT-B-16.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_CLIP_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_CLIP_big.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_CLIP_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_CLIP_big_laion.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_CLIP_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_CLIP_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_CLIP_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_CLIP_small_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_CLOOB_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_CLOOB_big.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_CLOOB_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_CLOOB_big_laion.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_CLOOB_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_CLOOB_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_CLOOB_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_CLOOB_small_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_ablations_CLIP_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_ablations_CLIP_big.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_ablations_CLIP_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_ablations_CLIP_big_laion.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_ablations_CLIP_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_ablations_CLIP_small_infoNCE.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_ablations_CLOOB_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_ablations_CLOOB_big.png -------------------------------------------------------------------------------- /figures/UMAP_sphere_ablations_CLOOB_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/UMAP_sphere_ablations_CLOOB_big_laion.png -------------------------------------------------------------------------------- /figures/cloob ViT-B-16_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/cloob ViT-B-16_PCA.png -------------------------------------------------------------------------------- /figures/hyperplane_after_CLIP_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_after_CLIP_big.png -------------------------------------------------------------------------------- /figures/hyperplane_after_CLIP_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_after_CLIP_big_laion.png -------------------------------------------------------------------------------- /figures/hyperplane_after_CLIP_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_after_CLIP_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/hyperplane_after_CLIP_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_after_CLIP_small_infoNCE.png -------------------------------------------------------------------------------- /figures/hyperplane_after_CLOOB_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_after_CLOOB_big.png -------------------------------------------------------------------------------- /figures/hyperplane_after_CLOOB_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_after_CLOOB_big_laion.png -------------------------------------------------------------------------------- /figures/hyperplane_after_CLOOB_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_after_CLOOB_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/hyperplane_after_CLOOB_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_after_CLOOB_small_infoNCE.png -------------------------------------------------------------------------------- /figures/hyperplane_before_CLIP_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_before_CLIP_big.png -------------------------------------------------------------------------------- /figures/hyperplane_before_CLIP_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_before_CLIP_big_laion.png -------------------------------------------------------------------------------- /figures/hyperplane_before_CLIP_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_before_CLIP_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/hyperplane_before_CLIP_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_before_CLIP_small_infoNCE.png -------------------------------------------------------------------------------- /figures/hyperplane_before_CLOOB_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_before_CLOOB_big.png -------------------------------------------------------------------------------- /figures/hyperplane_before_CLOOB_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_before_CLOOB_big_laion.png -------------------------------------------------------------------------------- /figures/hyperplane_before_CLOOB_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_before_CLOOB_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/hyperplane_before_CLOOB_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_before_CLOOB_small_infoNCE.png -------------------------------------------------------------------------------- /figures/hyperplane_clustered_before_CLIP_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clustered_before_CLIP_big.png -------------------------------------------------------------------------------- /figures/hyperplane_clustered_before_CLIP_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clustered_before_CLIP_big_laion.png -------------------------------------------------------------------------------- /figures/hyperplane_clustered_before_CLIP_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clustered_before_CLIP_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/hyperplane_clustered_before_CLIP_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clustered_before_CLIP_small_infoNCE.png -------------------------------------------------------------------------------- /figures/hyperplane_clustered_before_CLOOB_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clustered_before_CLOOB_big.png -------------------------------------------------------------------------------- /figures/hyperplane_clustered_before_CLOOB_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clustered_before_CLOOB_big_laion.png -------------------------------------------------------------------------------- /figures/hyperplane_clustered_before_CLOOB_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clustered_before_CLOOB_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/hyperplane_clustered_before_CLOOB_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clustered_before_CLOOB_small_infoNCE.png -------------------------------------------------------------------------------- /figures/hyperplane_clusterede_after_CLIP_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clusterede_after_CLIP_big.png -------------------------------------------------------------------------------- /figures/hyperplane_clusterede_after_CLIP_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clusterede_after_CLIP_big_laion.png -------------------------------------------------------------------------------- /figures/hyperplane_clusterede_after_CLIP_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clusterede_after_CLIP_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/hyperplane_clusterede_after_CLIP_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clusterede_after_CLIP_small_infoNCE.png -------------------------------------------------------------------------------- /figures/hyperplane_clusterede_after_CLOOB_big.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clusterede_after_CLOOB_big.png -------------------------------------------------------------------------------- /figures/hyperplane_clusterede_after_CLOOB_big_laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clusterede_after_CLOOB_big_laion.png -------------------------------------------------------------------------------- /figures/hyperplane_clusterede_after_CLOOB_small_infoLOOB.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clusterede_after_CLOOB_small_infoLOOB.png -------------------------------------------------------------------------------- /figures/hyperplane_clusterede_after_CLOOB_small_infoNCE.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/hyperplane_clusterede_after_CLOOB_small_infoNCE.png -------------------------------------------------------------------------------- /figures/img->text retrieval @1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/img->text retrieval @1.png -------------------------------------------------------------------------------- /figures/img->text retrieval @5.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/img->text retrieval @5.png -------------------------------------------------------------------------------- /figures/ml_jku_clip_infoLOOB_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/ml_jku_clip_infoLOOB_PCA.png -------------------------------------------------------------------------------- /figures/ml_jku_clip_rn50_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/ml_jku_clip_rn50_PCA.png -------------------------------------------------------------------------------- /figures/ml_jku_cloob_infoNCE_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/ml_jku_cloob_infoNCE_PCA.png -------------------------------------------------------------------------------- /figures/ml_jku_cloob_rn50_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/ml_jku_cloob_rn50_PCA.png -------------------------------------------------------------------------------- /figures/openclip ViT-B-16_PCA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/openclip ViT-B-16_PCA.png -------------------------------------------------------------------------------- /figures/text->img retrieval @1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/text->img retrieval @1.png -------------------------------------------------------------------------------- /figures/text->img retrieval @5.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/figures/text->img retrieval @5.png -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/requirements.txt -------------------------------------------------------------------------------- /svm_analysis.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EleutherAI/exploring-contrastive-topology/HEAD/svm_analysis.py --------------------------------------------------------------------------------