├── .gitignore ├── LICENSE ├── README.md ├── config ├── albert_base.json ├── albert_unittest.json ├── bert_base.json ├── generator_base.json ├── pretrain_electra.json ├── pretrain_mask.json ├── train_mrpc.json └── train_sst.json ├── data.py ├── data ├── .keep └── vocab.txt ├── download_glue_data.py ├── glue.py ├── img ├── n-gram.png └── tensorboardX.png ├── log └── .keep ├── models.py ├── optim.py ├── pretrain.py ├── requirements.txt ├── saved └── .keep ├── tokenization.py ├── train.py └── utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/README.md -------------------------------------------------------------------------------- /config/albert_base.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/config/albert_base.json -------------------------------------------------------------------------------- /config/albert_unittest.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/config/albert_unittest.json -------------------------------------------------------------------------------- /config/bert_base.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/config/bert_base.json -------------------------------------------------------------------------------- /config/generator_base.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/config/generator_base.json -------------------------------------------------------------------------------- /config/pretrain_electra.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/config/pretrain_electra.json -------------------------------------------------------------------------------- /config/pretrain_mask.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/config/pretrain_mask.json -------------------------------------------------------------------------------- /config/train_mrpc.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/config/train_mrpc.json -------------------------------------------------------------------------------- /config/train_sst.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/config/train_sst.json -------------------------------------------------------------------------------- /data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/data.py -------------------------------------------------------------------------------- /data/.keep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /data/vocab.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/data/vocab.txt -------------------------------------------------------------------------------- /download_glue_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/download_glue_data.py -------------------------------------------------------------------------------- /glue.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/glue.py -------------------------------------------------------------------------------- /img/n-gram.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/img/n-gram.png -------------------------------------------------------------------------------- /img/tensorboardX.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/img/tensorboardX.png -------------------------------------------------------------------------------- /log/.keep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/models.py -------------------------------------------------------------------------------- /optim.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/optim.py -------------------------------------------------------------------------------- /pretrain.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/pretrain.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/requirements.txt -------------------------------------------------------------------------------- /saved/.keep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tokenization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/tokenization.py -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/train.py -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/theblackcat102/ELECTRA-Pytorch/HEAD/utils.py --------------------------------------------------------------------------------