├── .DS_Store ├── .gitignore ├── Codes ├── BWN │ └── README.md ├── DoReFa │ ├── DoReFa.py │ ├── README.md │ ├── dorefa-BWN-training-log.png │ ├── main.py │ ├── models │ │ └── quantized_resnet.py │ ├── module.py │ ├── resnet.py │ ├── train.py │ └── visualize_training_log.py ├── FBS │ ├── FBS.py │ ├── FBS_utils │ │ └── module.py │ ├── README.md │ ├── models │ │ └── resnet.py │ └── visualize_training_log.py ├── README.md ├── TTQ │ ├── README.md │ ├── TTQ-ResNet20-STL10.png │ ├── TTQ.py │ ├── models │ │ └── ttq_resnet.py │ └── visualize_training_log.py ├── models │ ├── CIFARNet.py │ ├── layer_name_resnet.py │ └── resnet.py ├── train-base-model.py └── utils │ ├── CIFAR10_utils.py │ ├── INQ.py │ ├── MNIST_utils.py │ ├── QIL.py │ ├── SVHN_utils.py │ ├── TTQ.py │ ├── dataset.py │ ├── datasets │ ├── __init__.py │ ├── folder.py │ └── transforms.py │ ├── imagenet_utils.py │ ├── miscellaneous.py │ ├── quantize.py │ ├── recorder.py │ └── train.py ├── Figures └── llama_family.png ├── Paper ├── Conference │ ├── 2018.md │ ├── 2019.md │ ├── 2020.md │ ├── 2021.md │ ├── 2022.md │ ├── 2023.md │ ├── 2024.md │ └── 2025.md ├── Differentiable-Compression.md ├── Efficient-Model-Design.md ├── Large-Pretraining-Models │ ├── Agents.md │ ├── Architecture.md │ ├── Attention-Acceleration.md │ ├── Efficient-Training.md │ ├── In-Context Learning.md │ ├── KV-Cache.md │ ├── Low-Rank.md │ ├── Overall.md │ ├── Pruning.md │ ├── Quantization.md │ └── Retrieval.md ├── Meta-Learning.md ├── NAS.md ├── NLP-Compression.md ├── PaperByConference.md ├── Pruning.md ├── Quantization.md ├── Robust-Compression.md └── survey.md ├── README.md └── Summary ├── Prunning-Summary.pdf └── Quantization-Summary.pdf /.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/.DS_Store -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/.gitignore -------------------------------------------------------------------------------- /Codes/BWN/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/BWN/README.md -------------------------------------------------------------------------------- /Codes/DoReFa/DoReFa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/DoReFa/DoReFa.py -------------------------------------------------------------------------------- /Codes/DoReFa/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/DoReFa/README.md -------------------------------------------------------------------------------- /Codes/DoReFa/dorefa-BWN-training-log.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/DoReFa/dorefa-BWN-training-log.png -------------------------------------------------------------------------------- /Codes/DoReFa/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/DoReFa/main.py -------------------------------------------------------------------------------- /Codes/DoReFa/models/quantized_resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/DoReFa/models/quantized_resnet.py -------------------------------------------------------------------------------- /Codes/DoReFa/module.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/DoReFa/module.py -------------------------------------------------------------------------------- /Codes/DoReFa/resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/DoReFa/resnet.py -------------------------------------------------------------------------------- /Codes/DoReFa/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/DoReFa/train.py -------------------------------------------------------------------------------- /Codes/DoReFa/visualize_training_log.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/DoReFa/visualize_training_log.py -------------------------------------------------------------------------------- /Codes/FBS/FBS.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/FBS/FBS.py -------------------------------------------------------------------------------- /Codes/FBS/FBS_utils/module.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/FBS/FBS_utils/module.py -------------------------------------------------------------------------------- /Codes/FBS/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/FBS/README.md -------------------------------------------------------------------------------- /Codes/FBS/models/resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/FBS/models/resnet.py -------------------------------------------------------------------------------- /Codes/FBS/visualize_training_log.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/FBS/visualize_training_log.py -------------------------------------------------------------------------------- /Codes/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/README.md -------------------------------------------------------------------------------- /Codes/TTQ/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/TTQ/README.md -------------------------------------------------------------------------------- /Codes/TTQ/TTQ-ResNet20-STL10.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/TTQ/TTQ-ResNet20-STL10.png -------------------------------------------------------------------------------- /Codes/TTQ/TTQ.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/TTQ/TTQ.py -------------------------------------------------------------------------------- /Codes/TTQ/models/ttq_resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/TTQ/models/ttq_resnet.py -------------------------------------------------------------------------------- /Codes/TTQ/visualize_training_log.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/TTQ/visualize_training_log.py -------------------------------------------------------------------------------- /Codes/models/CIFARNet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/models/CIFARNet.py -------------------------------------------------------------------------------- /Codes/models/layer_name_resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/models/layer_name_resnet.py -------------------------------------------------------------------------------- /Codes/models/resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/models/resnet.py -------------------------------------------------------------------------------- /Codes/train-base-model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/train-base-model.py -------------------------------------------------------------------------------- /Codes/utils/CIFAR10_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/CIFAR10_utils.py -------------------------------------------------------------------------------- /Codes/utils/INQ.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/INQ.py -------------------------------------------------------------------------------- /Codes/utils/MNIST_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/MNIST_utils.py -------------------------------------------------------------------------------- /Codes/utils/QIL.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/QIL.py -------------------------------------------------------------------------------- /Codes/utils/SVHN_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/SVHN_utils.py -------------------------------------------------------------------------------- /Codes/utils/TTQ.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/TTQ.py -------------------------------------------------------------------------------- /Codes/utils/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/dataset.py -------------------------------------------------------------------------------- /Codes/utils/datasets/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/datasets/__init__.py -------------------------------------------------------------------------------- /Codes/utils/datasets/folder.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/datasets/folder.py -------------------------------------------------------------------------------- /Codes/utils/datasets/transforms.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/datasets/transforms.py -------------------------------------------------------------------------------- /Codes/utils/imagenet_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/imagenet_utils.py -------------------------------------------------------------------------------- /Codes/utils/miscellaneous.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/miscellaneous.py -------------------------------------------------------------------------------- /Codes/utils/quantize.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/quantize.py -------------------------------------------------------------------------------- /Codes/utils/recorder.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/recorder.py -------------------------------------------------------------------------------- /Codes/utils/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Codes/utils/train.py -------------------------------------------------------------------------------- /Figures/llama_family.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Figures/llama_family.png -------------------------------------------------------------------------------- /Paper/Conference/2018.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Conference/2018.md -------------------------------------------------------------------------------- /Paper/Conference/2019.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Conference/2019.md -------------------------------------------------------------------------------- /Paper/Conference/2020.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Conference/2020.md -------------------------------------------------------------------------------- /Paper/Conference/2021.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Conference/2021.md -------------------------------------------------------------------------------- /Paper/Conference/2022.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Conference/2022.md -------------------------------------------------------------------------------- /Paper/Conference/2023.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Conference/2023.md -------------------------------------------------------------------------------- /Paper/Conference/2024.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Conference/2024.md -------------------------------------------------------------------------------- /Paper/Conference/2025.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Conference/2025.md -------------------------------------------------------------------------------- /Paper/Differentiable-Compression.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Differentiable-Compression.md -------------------------------------------------------------------------------- /Paper/Efficient-Model-Design.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Efficient-Model-Design.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/Agents.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/Agents.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/Architecture.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/Architecture.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/Attention-Acceleration.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/Attention-Acceleration.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/Efficient-Training.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/Efficient-Training.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/In-Context Learning.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/In-Context Learning.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/KV-Cache.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/KV-Cache.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/Low-Rank.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/Low-Rank.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/Overall.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/Overall.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/Pruning.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/Pruning.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/Quantization.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/Quantization.md -------------------------------------------------------------------------------- /Paper/Large-Pretraining-Models/Retrieval.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Large-Pretraining-Models/Retrieval.md -------------------------------------------------------------------------------- /Paper/Meta-Learning.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Meta-Learning.md -------------------------------------------------------------------------------- /Paper/NAS.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/NAS.md -------------------------------------------------------------------------------- /Paper/NLP-Compression.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/NLP-Compression.md -------------------------------------------------------------------------------- /Paper/PaperByConference.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/PaperByConference.md -------------------------------------------------------------------------------- /Paper/Pruning.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Pruning.md -------------------------------------------------------------------------------- /Paper/Quantization.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Quantization.md -------------------------------------------------------------------------------- /Paper/Robust-Compression.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/Robust-Compression.md -------------------------------------------------------------------------------- /Paper/survey.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Paper/survey.md -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/README.md -------------------------------------------------------------------------------- /Summary/Prunning-Summary.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Summary/Prunning-Summary.pdf -------------------------------------------------------------------------------- /Summary/Quantization-Summary.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/csyhhu/Awesome-Deep-Neural-Network-Compression/HEAD/Summary/Quantization-Summary.pdf --------------------------------------------------------------------------------