├── LICENSE ├── README.md ├── assets ├── .DS_Store ├── dist.png ├── mimic.png ├── mimic_icon.png └── pretrain.png ├── datasets ├── 3dstreet_multipro.py ├── DATASET.md ├── apple_multipro.py ├── apple_rotation.npy ├── co3d_multipro.py ├── constants.py ├── dataset.yml ├── demon.py ├── gibson_multipro.py ├── hm3d_multipro.py ├── mannequin_multipro.py ├── matterport_multipro.py ├── scannet_multipro.py ├── syn_utils.py └── utils.py ├── finetune ├── .DS_Store ├── ade20k_log.txt ├── in1k_12357031_0_log.out ├── nyuv2_log.txt └── taskonomy_log.txt ├── model ├── PRETRAIN.md ├── cross_attention.py ├── engine_pretrain.py ├── mae.yml ├── main_pretrain.py ├── models_mae.py ├── models_multiviewmae.py ├── models_vit.py ├── submitit_pretrain.py └── util │ ├── crop.py │ ├── datasets.py │ ├── lars.py │ ├── lr_decay.py │ ├── lr_sched.py │ ├── megadataset.py │ ├── misc.py │ ├── multiviewdatasets.py │ └── pos_embed.py └── scripts └── croco_multiview_pretrain.sh /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/README.md -------------------------------------------------------------------------------- /assets/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/assets/.DS_Store -------------------------------------------------------------------------------- /assets/dist.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/assets/dist.png -------------------------------------------------------------------------------- /assets/mimic.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/assets/mimic.png -------------------------------------------------------------------------------- /assets/mimic_icon.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/assets/mimic_icon.png -------------------------------------------------------------------------------- /assets/pretrain.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/assets/pretrain.png -------------------------------------------------------------------------------- /datasets/3dstreet_multipro.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/3dstreet_multipro.py -------------------------------------------------------------------------------- /datasets/DATASET.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/DATASET.md -------------------------------------------------------------------------------- /datasets/apple_multipro.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/apple_multipro.py -------------------------------------------------------------------------------- /datasets/apple_rotation.npy: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/apple_rotation.npy -------------------------------------------------------------------------------- /datasets/co3d_multipro.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/co3d_multipro.py -------------------------------------------------------------------------------- /datasets/constants.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/constants.py -------------------------------------------------------------------------------- /datasets/dataset.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/dataset.yml -------------------------------------------------------------------------------- /datasets/demon.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/demon.py -------------------------------------------------------------------------------- /datasets/gibson_multipro.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/gibson_multipro.py -------------------------------------------------------------------------------- /datasets/hm3d_multipro.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/hm3d_multipro.py -------------------------------------------------------------------------------- /datasets/mannequin_multipro.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/mannequin_multipro.py -------------------------------------------------------------------------------- /datasets/matterport_multipro.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/matterport_multipro.py -------------------------------------------------------------------------------- /datasets/scannet_multipro.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/scannet_multipro.py -------------------------------------------------------------------------------- /datasets/syn_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/syn_utils.py -------------------------------------------------------------------------------- /datasets/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/datasets/utils.py -------------------------------------------------------------------------------- /finetune/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/finetune/.DS_Store -------------------------------------------------------------------------------- /finetune/ade20k_log.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/finetune/ade20k_log.txt -------------------------------------------------------------------------------- /finetune/in1k_12357031_0_log.out: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/finetune/in1k_12357031_0_log.out -------------------------------------------------------------------------------- /finetune/nyuv2_log.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/finetune/nyuv2_log.txt -------------------------------------------------------------------------------- /finetune/taskonomy_log.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/finetune/taskonomy_log.txt -------------------------------------------------------------------------------- /model/PRETRAIN.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/PRETRAIN.md -------------------------------------------------------------------------------- /model/cross_attention.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/cross_attention.py -------------------------------------------------------------------------------- /model/engine_pretrain.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/engine_pretrain.py -------------------------------------------------------------------------------- /model/mae.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/mae.yml -------------------------------------------------------------------------------- /model/main_pretrain.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/main_pretrain.py -------------------------------------------------------------------------------- /model/models_mae.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/models_mae.py -------------------------------------------------------------------------------- /model/models_multiviewmae.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/models_multiviewmae.py -------------------------------------------------------------------------------- /model/models_vit.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/models_vit.py -------------------------------------------------------------------------------- /model/submitit_pretrain.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/submitit_pretrain.py -------------------------------------------------------------------------------- /model/util/crop.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/util/crop.py -------------------------------------------------------------------------------- /model/util/datasets.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/util/datasets.py -------------------------------------------------------------------------------- /model/util/lars.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/util/lars.py -------------------------------------------------------------------------------- /model/util/lr_decay.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/util/lr_decay.py -------------------------------------------------------------------------------- /model/util/lr_sched.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/util/lr_sched.py -------------------------------------------------------------------------------- /model/util/megadataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/util/megadataset.py -------------------------------------------------------------------------------- /model/util/misc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/util/misc.py -------------------------------------------------------------------------------- /model/util/multiviewdatasets.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/util/multiviewdatasets.py -------------------------------------------------------------------------------- /model/util/pos_embed.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/model/util/pos_embed.py -------------------------------------------------------------------------------- /scripts/croco_multiview_pretrain.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/MIMIC/HEAD/scripts/croco_multiview_pretrain.sh --------------------------------------------------------------------------------