├── .gitignore ├── LICENSE ├── README.md ├── assets ├── DiT_XL_2_dense.png ├── DiT_XL_2_magnitude.png ├── DiT_XL_2_sparsegpt.png ├── DiT_XL_2_sparsegpt_updated.png ├── DiT_XL_2_wanda.png ├── framework.png └── gumbel_softmax.png ├── diffusion_transformers ├── __init__.py ├── diffusion │ ├── __init__.py │ ├── diffusion_utils.py │ ├── gaussian_diffusion.py │ ├── respace.py │ └── timestep_sampler.py ├── download.py └── models.py ├── oneshot_pruning_dit.py ├── oneshot_pruning_timm.py ├── requirements.txt ├── sample.py ├── scripts ├── maskllm_1epoch_vit_base_patch16_224.augreg_in1k.magnitude24.sh ├── maskllm_1epoch_vit_base_patch16_224.augreg_in1k.sparsegpt24.sh ├── maskllm_vit_base_patch16_224.augreg_in1k.magnitude24.sh └── maskllm_vit_base_patch16_224.augreg_in1k.sparsegpt24.sh ├── sparsity ├── __init__.py ├── maskllm.py ├── sparsegpt.py └── utils.py ├── timm_train.py └── timm_validate.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/README.md -------------------------------------------------------------------------------- /assets/DiT_XL_2_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/assets/DiT_XL_2_dense.png -------------------------------------------------------------------------------- /assets/DiT_XL_2_magnitude.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/assets/DiT_XL_2_magnitude.png -------------------------------------------------------------------------------- /assets/DiT_XL_2_sparsegpt.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/assets/DiT_XL_2_sparsegpt.png -------------------------------------------------------------------------------- /assets/DiT_XL_2_sparsegpt_updated.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/assets/DiT_XL_2_sparsegpt_updated.png -------------------------------------------------------------------------------- /assets/DiT_XL_2_wanda.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/assets/DiT_XL_2_wanda.png -------------------------------------------------------------------------------- /assets/framework.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/assets/framework.png -------------------------------------------------------------------------------- /assets/gumbel_softmax.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/assets/gumbel_softmax.png -------------------------------------------------------------------------------- /diffusion_transformers/__init__.py: -------------------------------------------------------------------------------- 1 | from . import download, models, diffusion -------------------------------------------------------------------------------- /diffusion_transformers/diffusion/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/diffusion_transformers/diffusion/__init__.py -------------------------------------------------------------------------------- /diffusion_transformers/diffusion/diffusion_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/diffusion_transformers/diffusion/diffusion_utils.py -------------------------------------------------------------------------------- /diffusion_transformers/diffusion/gaussian_diffusion.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/diffusion_transformers/diffusion/gaussian_diffusion.py -------------------------------------------------------------------------------- /diffusion_transformers/diffusion/respace.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/diffusion_transformers/diffusion/respace.py -------------------------------------------------------------------------------- /diffusion_transformers/diffusion/timestep_sampler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/diffusion_transformers/diffusion/timestep_sampler.py -------------------------------------------------------------------------------- /diffusion_transformers/download.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/diffusion_transformers/download.py -------------------------------------------------------------------------------- /diffusion_transformers/models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/diffusion_transformers/models.py -------------------------------------------------------------------------------- /oneshot_pruning_dit.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/oneshot_pruning_dit.py -------------------------------------------------------------------------------- /oneshot_pruning_timm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/oneshot_pruning_timm.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | torch 2 | timm 3 | diffusers 4 | wandb -------------------------------------------------------------------------------- /sample.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/sample.py -------------------------------------------------------------------------------- /scripts/maskllm_1epoch_vit_base_patch16_224.augreg_in1k.magnitude24.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/scripts/maskllm_1epoch_vit_base_patch16_224.augreg_in1k.magnitude24.sh -------------------------------------------------------------------------------- /scripts/maskllm_1epoch_vit_base_patch16_224.augreg_in1k.sparsegpt24.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/scripts/maskllm_1epoch_vit_base_patch16_224.augreg_in1k.sparsegpt24.sh -------------------------------------------------------------------------------- /scripts/maskllm_vit_base_patch16_224.augreg_in1k.magnitude24.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/scripts/maskllm_vit_base_patch16_224.augreg_in1k.magnitude24.sh -------------------------------------------------------------------------------- /scripts/maskllm_vit_base_patch16_224.augreg_in1k.sparsegpt24.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/scripts/maskllm_vit_base_patch16_224.augreg_in1k.sparsegpt24.sh -------------------------------------------------------------------------------- /sparsity/__init__.py: -------------------------------------------------------------------------------- 1 | from .import maskllm, utils, sparsegpt -------------------------------------------------------------------------------- /sparsity/maskllm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/sparsity/maskllm.py -------------------------------------------------------------------------------- /sparsity/sparsegpt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/sparsity/sparsegpt.py -------------------------------------------------------------------------------- /sparsity/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/sparsity/utils.py -------------------------------------------------------------------------------- /timm_train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/timm_train.py -------------------------------------------------------------------------------- /timm_validate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/VainF/MaskLLM-4V/HEAD/timm_validate.py --------------------------------------------------------------------------------