├── .gitignore ├── LICENSE ├── README.md ├── classify.py ├── config ├── albert_base.json ├── albert_unittest.json ├── bert_base.json ├── pretrain.json └── train_mrpc.json ├── data ├── .keep └── vocab.txt ├── img ├── n-gram.png └── tensorboardX.png ├── log └── .keep ├── models.py ├── optim.py ├── pretrain.py ├── saved └── .keep ├── tokenization.py ├── train.py └── utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/README.md -------------------------------------------------------------------------------- /classify.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/classify.py -------------------------------------------------------------------------------- /config/albert_base.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/config/albert_base.json -------------------------------------------------------------------------------- /config/albert_unittest.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/config/albert_unittest.json -------------------------------------------------------------------------------- /config/bert_base.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/config/bert_base.json -------------------------------------------------------------------------------- /config/pretrain.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/config/pretrain.json -------------------------------------------------------------------------------- /config/train_mrpc.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/config/train_mrpc.json -------------------------------------------------------------------------------- /data/.keep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /data/vocab.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/data/vocab.txt -------------------------------------------------------------------------------- /img/n-gram.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/img/n-gram.png -------------------------------------------------------------------------------- /img/tensorboardX.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/img/tensorboardX.png -------------------------------------------------------------------------------- /log/.keep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/models.py -------------------------------------------------------------------------------- /optim.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/optim.py -------------------------------------------------------------------------------- /pretrain.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/pretrain.py -------------------------------------------------------------------------------- /saved/.keep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tokenization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/tokenization.py -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/train.py -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/graykode/ALBERT-Pytorch/HEAD/utils.py --------------------------------------------------------------------------------