├── .gitignore ├── MANIFEST.in ├── README.md ├── Saving_PruneBERT.ipynb ├── block_movement_pruning ├── __init__.py ├── bertarize.py ├── command_line.py ├── counts_parameters.py ├── emmental │ ├── __init__.py │ ├── configuration_bert_masked.py │ ├── modeling_bert_masked.py │ └── modules │ │ ├── __init__.py │ │ ├── binarizer.py │ │ └── masked_nn.py ├── masked_run_glue.py ├── masked_run_squad.py ├── model_card │ ├── layer_images │ │ ├── layer_0_attention_output_dense.png │ │ ├── layer_0_attention_self_key.png │ │ ├── layer_0_attention_self_query.png │ │ ├── layer_0_attention_self_value.png │ │ ├── layer_0_intermediate_dense.png │ │ ├── layer_0_output_dense.png │ │ ├── layer_10_attention_output_dense.png │ │ ├── layer_10_attention_self_key.png │ │ ├── layer_10_attention_self_query.png │ │ ├── layer_10_attention_self_value.png │ │ ├── layer_10_intermediate_dense.png │ │ ├── layer_10_output_dense.png │ │ ├── layer_11_attention_output_dense.png │ │ ├── layer_11_attention_self_key.png │ │ ├── layer_11_attention_self_query.png │ │ ├── layer_11_attention_self_value.png │ │ ├── layer_11_intermediate_dense.png │ │ ├── layer_11_output_dense.png │ │ ├── layer_1_attention_output_dense.png │ │ ├── layer_1_attention_self_key.png │ │ ├── layer_1_attention_self_query.png │ │ ├── layer_1_attention_self_value.png │ │ ├── layer_1_intermediate_dense.png │ │ ├── layer_1_output_dense.png │ │ ├── layer_2_attention_output_dense.png │ │ ├── layer_2_attention_self_key.png │ │ ├── layer_2_attention_self_query.png │ │ ├── layer_2_attention_self_value.png │ │ ├── layer_2_intermediate_dense.png │ │ ├── layer_2_output_dense.png │ │ ├── layer_3_attention_output_dense.png │ │ ├── layer_3_attention_self_key.png │ │ ├── layer_3_attention_self_query.png │ │ ├── layer_3_attention_self_value.png │ │ ├── layer_3_intermediate_dense.png │ │ ├── layer_3_output_dense.png │ │ ├── layer_4_attention_output_dense.png │ │ ├── layer_4_attention_self_key.png │ │ ├── layer_4_attention_self_query.png │ │ ├── layer_4_attention_self_value.png │ │ ├── layer_4_intermediate_dense.png │ │ ├── layer_4_output_dense.png │ │ ├── layer_5_attention_output_dense.png │ │ ├── layer_5_attention_self_key.png │ │ ├── layer_5_attention_self_query.png │ │ ├── layer_5_attention_self_value.png │ │ ├── layer_5_intermediate_dense.png │ │ ├── layer_5_output_dense.png │ │ ├── layer_6_attention_output_dense.png │ │ ├── layer_6_attention_self_key.png │ │ ├── layer_6_attention_self_query.png │ │ ├── layer_6_attention_self_value.png │ │ ├── layer_6_intermediate_dense.png │ │ ├── layer_6_output_dense.png │ │ ├── layer_7_attention_output_dense.png │ │ ├── layer_7_attention_self_key.png │ │ ├── layer_7_attention_self_query.png │ │ ├── layer_7_attention_self_value.png │ │ ├── layer_7_intermediate_dense.png │ │ ├── layer_7_output_dense.png │ │ ├── layer_8_attention_output_dense.png │ │ ├── layer_8_attention_self_key.png │ │ ├── layer_8_attention_self_query.png │ │ ├── layer_8_attention_self_value.png │ │ ├── layer_8_intermediate_dense.png │ │ ├── layer_8_output_dense.png │ │ ├── layer_9_attention_output_dense.png │ │ ├── layer_9_attention_self_key.png │ │ ├── layer_9_attention_self_query.png │ │ ├── layer_9_attention_self_value.png │ │ ├── layer_9_intermediate_dense.png │ │ └── layer_9_output_dense.png │ └── pruning.svg ├── run.sh └── tests │ ├── __init__.py │ └── test_fun.py ├── requirements.txt └── setup.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/.gitignore -------------------------------------------------------------------------------- /MANIFEST.in: -------------------------------------------------------------------------------- 1 | include README.rst -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/README.md -------------------------------------------------------------------------------- /Saving_PruneBERT.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/Saving_PruneBERT.ipynb -------------------------------------------------------------------------------- /block_movement_pruning/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /block_movement_pruning/bertarize.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/bertarize.py -------------------------------------------------------------------------------- /block_movement_pruning/command_line.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/command_line.py -------------------------------------------------------------------------------- /block_movement_pruning/counts_parameters.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/counts_parameters.py -------------------------------------------------------------------------------- /block_movement_pruning/emmental/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/emmental/__init__.py -------------------------------------------------------------------------------- /block_movement_pruning/emmental/configuration_bert_masked.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/emmental/configuration_bert_masked.py -------------------------------------------------------------------------------- /block_movement_pruning/emmental/modeling_bert_masked.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/emmental/modeling_bert_masked.py -------------------------------------------------------------------------------- /block_movement_pruning/emmental/modules/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/emmental/modules/__init__.py -------------------------------------------------------------------------------- /block_movement_pruning/emmental/modules/binarizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/emmental/modules/binarizer.py -------------------------------------------------------------------------------- /block_movement_pruning/emmental/modules/masked_nn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/emmental/modules/masked_nn.py -------------------------------------------------------------------------------- /block_movement_pruning/masked_run_glue.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/masked_run_glue.py -------------------------------------------------------------------------------- /block_movement_pruning/masked_run_squad.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/masked_run_squad.py -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_0_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_0_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_0_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_0_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_0_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_0_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_0_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_0_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_0_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_0_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_0_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_0_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_10_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_10_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_10_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_10_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_10_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_10_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_10_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_10_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_10_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_10_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_10_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_10_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_11_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_11_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_11_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_11_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_11_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_11_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_11_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_11_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_11_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_11_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_11_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_11_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_1_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_1_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_1_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_1_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_1_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_1_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_1_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_1_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_1_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_1_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_1_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_1_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_2_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_2_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_2_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_2_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_2_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_2_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_2_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_2_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_2_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_2_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_2_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_2_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_3_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_3_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_3_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_3_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_3_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_3_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_3_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_3_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_3_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_3_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_3_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_3_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_4_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_4_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_4_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_4_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_4_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_4_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_4_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_4_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_4_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_4_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_4_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_4_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_5_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_5_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_5_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_5_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_5_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_5_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_5_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_5_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_5_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_5_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_5_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_5_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_6_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_6_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_6_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_6_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_6_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_6_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_6_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_6_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_6_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_6_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_6_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_6_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_7_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_7_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_7_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_7_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_7_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_7_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_7_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_7_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_7_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_7_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_7_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_7_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_8_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_8_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_8_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_8_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_8_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_8_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_8_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_8_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_8_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_8_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_8_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_8_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_9_attention_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_9_attention_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_9_attention_self_key.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_9_attention_self_key.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_9_attention_self_query.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_9_attention_self_query.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_9_attention_self_value.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_9_attention_self_value.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_9_intermediate_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_9_intermediate_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/layer_images/layer_9_output_dense.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/layer_images/layer_9_output_dense.png -------------------------------------------------------------------------------- /block_movement_pruning/model_card/pruning.svg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/model_card/pruning.svg -------------------------------------------------------------------------------- /block_movement_pruning/run.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/run.sh -------------------------------------------------------------------------------- /block_movement_pruning/tests/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /block_movement_pruning/tests/test_fun.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/block_movement_pruning/tests/test_fun.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/requirements.txt -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/huggingface/block_movement_pruning/HEAD/setup.py --------------------------------------------------------------------------------