├── .gitignore ├── README.md ├── crd ├── __init__.py ├── criterion.py └── memory.py ├── dataset ├── __init__.py ├── cifar100.py └── imagenet.py ├── distiller_zoo ├── AB.py ├── AT.py ├── CC.py ├── FSP.py ├── FT.py ├── FitNet.py ├── KD.py ├── KDSVD.py ├── NST.py ├── PKT.py ├── RKD.py ├── SP.py ├── VID.py └── __init__.py ├── examples ├── __init__.py ├── cifar100.png ├── fig1.png └── imagenet.png ├── helper ├── __init__.py ├── loops.py ├── pretrain.py └── util.py ├── models ├── ShuffleNetv1.py ├── ShuffleNetv2.py ├── __init__.py ├── classifier.py ├── mobilenetv2.py ├── resnet.py ├── resnetv2.py ├── util.py ├── vgg.py └── wrn.py ├── scripts ├── fetch_pretrained_teachers.sh ├── run_cifar_distill.sh └── run_cifar_vanilla.sh ├── supermix.py ├── train_student.py └── train_teacher.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/README.md -------------------------------------------------------------------------------- /crd/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /crd/criterion.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/crd/criterion.py -------------------------------------------------------------------------------- /crd/memory.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/crd/memory.py -------------------------------------------------------------------------------- /dataset/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /dataset/cifar100.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/dataset/cifar100.py -------------------------------------------------------------------------------- /dataset/imagenet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/dataset/imagenet.py -------------------------------------------------------------------------------- /distiller_zoo/AB.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/AB.py -------------------------------------------------------------------------------- /distiller_zoo/AT.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/AT.py -------------------------------------------------------------------------------- /distiller_zoo/CC.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/CC.py -------------------------------------------------------------------------------- /distiller_zoo/FSP.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/FSP.py -------------------------------------------------------------------------------- /distiller_zoo/FT.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/FT.py -------------------------------------------------------------------------------- /distiller_zoo/FitNet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/FitNet.py -------------------------------------------------------------------------------- /distiller_zoo/KD.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/KD.py -------------------------------------------------------------------------------- /distiller_zoo/KDSVD.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/KDSVD.py -------------------------------------------------------------------------------- /distiller_zoo/NST.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/NST.py -------------------------------------------------------------------------------- /distiller_zoo/PKT.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/PKT.py -------------------------------------------------------------------------------- /distiller_zoo/RKD.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/RKD.py -------------------------------------------------------------------------------- /distiller_zoo/SP.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/SP.py -------------------------------------------------------------------------------- /distiller_zoo/VID.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/VID.py -------------------------------------------------------------------------------- /distiller_zoo/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/distiller_zoo/__init__.py -------------------------------------------------------------------------------- /examples/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /examples/cifar100.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/examples/cifar100.png -------------------------------------------------------------------------------- /examples/fig1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/examples/fig1.png -------------------------------------------------------------------------------- /examples/imagenet.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/examples/imagenet.png -------------------------------------------------------------------------------- /helper/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /helper/loops.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/helper/loops.py -------------------------------------------------------------------------------- /helper/pretrain.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/helper/pretrain.py -------------------------------------------------------------------------------- /helper/util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/helper/util.py -------------------------------------------------------------------------------- /models/ShuffleNetv1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/models/ShuffleNetv1.py -------------------------------------------------------------------------------- /models/ShuffleNetv2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/models/ShuffleNetv2.py -------------------------------------------------------------------------------- /models/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/models/__init__.py -------------------------------------------------------------------------------- /models/classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/models/classifier.py -------------------------------------------------------------------------------- /models/mobilenetv2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/models/mobilenetv2.py -------------------------------------------------------------------------------- /models/resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/models/resnet.py -------------------------------------------------------------------------------- /models/resnetv2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/models/resnetv2.py -------------------------------------------------------------------------------- /models/util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/models/util.py -------------------------------------------------------------------------------- /models/vgg.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/models/vgg.py -------------------------------------------------------------------------------- /models/wrn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/models/wrn.py -------------------------------------------------------------------------------- /scripts/fetch_pretrained_teachers.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/scripts/fetch_pretrained_teachers.sh -------------------------------------------------------------------------------- /scripts/run_cifar_distill.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/scripts/run_cifar_distill.sh -------------------------------------------------------------------------------- /scripts/run_cifar_vanilla.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/scripts/run_cifar_vanilla.sh -------------------------------------------------------------------------------- /supermix.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/supermix.py -------------------------------------------------------------------------------- /train_student.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/train_student.py -------------------------------------------------------------------------------- /train_teacher.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alldbi/SuperMix/HEAD/train_teacher.py --------------------------------------------------------------------------------