├── .gitignore ├── README.md ├── Supplementary.pdf └── code ├── image_classfication ├── README.md ├── [2]_TLD-SD.ipynb ├── grad_distance.ipynb ├── grid_plot.ipynb ├── main.py ├── models │ ├── cifar │ │ ├── ResNet.py │ │ ├── WideResNet.py │ │ └── __init__.py │ └── imagenet │ │ ├── MobileNetV2.py │ │ ├── ResNet.py │ │ └── __init__.py ├── pdf_plot.ipynb ├── run_vanilla.sh ├── run_vanilla_kd.sh ├── run_vanilla_kd_data.sh ├── tools │ ├── data_setter.py │ ├── distiller_zoo │ │ ├── AB.py │ │ ├── AT.py │ │ ├── CC.py │ │ ├── FSP.py │ │ ├── FT.py │ │ ├── FitNet.py │ │ ├── KD.py │ │ ├── KDSVD.py │ │ ├── NST.py │ │ ├── PKT.py │ │ ├── RKD.py │ │ ├── SP.py │ │ ├── VID.py │ │ └── __init__.py │ ├── generator.py │ ├── loader.py │ ├── losses.py │ ├── traineval.py │ └── visualize.py ├── transforms │ ├── __init__.py │ ├── autoaugment.py │ └── cutout.py └── visualize_example.ipynb └── machine_translation ├── README.md └── prepare_reduce_data.py /.gitignore: -------------------------------------------------------------------------------- 1 | .ipynb_checkpoints/ 2 | __pycache__/ 3 | .DS_Store 4 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/README.md -------------------------------------------------------------------------------- /Supplementary.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/Supplementary.pdf -------------------------------------------------------------------------------- /code/image_classfication/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/README.md -------------------------------------------------------------------------------- /code/image_classfication/[2]_TLD-SD.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/[2]_TLD-SD.ipynb -------------------------------------------------------------------------------- /code/image_classfication/grad_distance.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/grad_distance.ipynb -------------------------------------------------------------------------------- /code/image_classfication/grid_plot.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/grid_plot.ipynb -------------------------------------------------------------------------------- /code/image_classfication/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/main.py -------------------------------------------------------------------------------- /code/image_classfication/models/cifar/ResNet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/models/cifar/ResNet.py -------------------------------------------------------------------------------- /code/image_classfication/models/cifar/WideResNet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/models/cifar/WideResNet.py -------------------------------------------------------------------------------- /code/image_classfication/models/cifar/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/models/cifar/__init__.py -------------------------------------------------------------------------------- /code/image_classfication/models/imagenet/MobileNetV2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/models/imagenet/MobileNetV2.py -------------------------------------------------------------------------------- /code/image_classfication/models/imagenet/ResNet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/models/imagenet/ResNet.py -------------------------------------------------------------------------------- /code/image_classfication/models/imagenet/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/models/imagenet/__init__.py -------------------------------------------------------------------------------- /code/image_classfication/pdf_plot.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/pdf_plot.ipynb -------------------------------------------------------------------------------- /code/image_classfication/run_vanilla.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/run_vanilla.sh -------------------------------------------------------------------------------- /code/image_classfication/run_vanilla_kd.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/run_vanilla_kd.sh -------------------------------------------------------------------------------- /code/image_classfication/run_vanilla_kd_data.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/run_vanilla_kd_data.sh -------------------------------------------------------------------------------- /code/image_classfication/tools/data_setter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/data_setter.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/AB.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/AB.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/AT.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/AT.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/CC.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/CC.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/FSP.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/FSP.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/FT.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/FT.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/FitNet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/FitNet.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/KD.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/KD.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/KDSVD.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/KDSVD.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/NST.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/NST.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/PKT.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/PKT.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/RKD.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/RKD.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/SP.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/SP.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/VID.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/VID.py -------------------------------------------------------------------------------- /code/image_classfication/tools/distiller_zoo/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/distiller_zoo/__init__.py -------------------------------------------------------------------------------- /code/image_classfication/tools/generator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/generator.py -------------------------------------------------------------------------------- /code/image_classfication/tools/loader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/loader.py -------------------------------------------------------------------------------- /code/image_classfication/tools/losses.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/losses.py -------------------------------------------------------------------------------- /code/image_classfication/tools/traineval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/traineval.py -------------------------------------------------------------------------------- /code/image_classfication/tools/visualize.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/tools/visualize.py -------------------------------------------------------------------------------- /code/image_classfication/transforms/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/transforms/__init__.py -------------------------------------------------------------------------------- /code/image_classfication/transforms/autoaugment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/transforms/autoaugment.py -------------------------------------------------------------------------------- /code/image_classfication/transforms/cutout.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/transforms/cutout.py -------------------------------------------------------------------------------- /code/image_classfication/visualize_example.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/image_classfication/visualize_example.ipynb -------------------------------------------------------------------------------- /code/machine_translation/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/machine_translation/README.md -------------------------------------------------------------------------------- /code/machine_translation/prepare_reduce_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/jhoon-oh/kd_data/HEAD/code/machine_translation/prepare_reduce_data.py --------------------------------------------------------------------------------