├── .gitignore ├── README.md ├── data ├── aug_en_data.txt ├── en_data.txt ├── eval.txt └── train.txt ├── data_augmentation.py ├── general_distill.py ├── requirements.txt ├── script ├── data_augmentation.sh ├── general_train.sh └── task_train.sh ├── student_model └── config.json ├── task_distill.py └── transformer ├── __init__.py ├── file_utils.py ├── modeling.py ├── optimization.py └── tokenization.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/README.md -------------------------------------------------------------------------------- /data/aug_en_data.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/data/aug_en_data.txt -------------------------------------------------------------------------------- /data/en_data.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/data/en_data.txt -------------------------------------------------------------------------------- /data/eval.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/data/eval.txt -------------------------------------------------------------------------------- /data/train.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/data/train.txt -------------------------------------------------------------------------------- /data_augmentation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/data_augmentation.py -------------------------------------------------------------------------------- /general_distill.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/general_distill.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/requirements.txt -------------------------------------------------------------------------------- /script/data_augmentation.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/script/data_augmentation.sh -------------------------------------------------------------------------------- /script/general_train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/script/general_train.sh -------------------------------------------------------------------------------- /script/task_train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/script/task_train.sh -------------------------------------------------------------------------------- /student_model/config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/student_model/config.json -------------------------------------------------------------------------------- /task_distill.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/task_distill.py -------------------------------------------------------------------------------- /transformer/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/transformer/__init__.py -------------------------------------------------------------------------------- /transformer/file_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/transformer/file_utils.py -------------------------------------------------------------------------------- /transformer/modeling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/transformer/modeling.py -------------------------------------------------------------------------------- /transformer/optimization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/transformer/optimization.py -------------------------------------------------------------------------------- /transformer/tokenization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Lisennlp/TinyBert/HEAD/transformer/tokenization.py --------------------------------------------------------------------------------