├── README.md ├── albert_modeling.py ├── bert_modeling.py ├── config ├── ale_base.json ├── ale_small.json └── electra_small.json ├── create_book_data.sh ├── create_pretraining_data.py ├── create_wiki_data.sh ├── glue.sh ├── lamb.py ├── mcc.py ├── optimization.py ├── pretrain.sh ├── run_classifier.py ├── run_pretrain.py ├── testing └── Austen_PridePrejudice_1342.txt ├── tokenization.py └── vocab.txt /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/README.md -------------------------------------------------------------------------------- /albert_modeling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/albert_modeling.py -------------------------------------------------------------------------------- /bert_modeling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/bert_modeling.py -------------------------------------------------------------------------------- /config/ale_base.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/config/ale_base.json -------------------------------------------------------------------------------- /config/ale_small.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/config/ale_small.json -------------------------------------------------------------------------------- /config/electra_small.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/config/electra_small.json -------------------------------------------------------------------------------- /create_book_data.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/create_book_data.sh -------------------------------------------------------------------------------- /create_pretraining_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/create_pretraining_data.py -------------------------------------------------------------------------------- /create_wiki_data.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/create_wiki_data.sh -------------------------------------------------------------------------------- /glue.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/glue.sh -------------------------------------------------------------------------------- /lamb.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/lamb.py -------------------------------------------------------------------------------- /mcc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/mcc.py -------------------------------------------------------------------------------- /optimization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/optimization.py -------------------------------------------------------------------------------- /pretrain.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/pretrain.sh -------------------------------------------------------------------------------- /run_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/run_classifier.py -------------------------------------------------------------------------------- /run_pretrain.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/run_pretrain.py -------------------------------------------------------------------------------- /testing/Austen_PridePrejudice_1342.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/testing/Austen_PridePrejudice_1342.txt -------------------------------------------------------------------------------- /tokenization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/tokenization.py -------------------------------------------------------------------------------- /vocab.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/hsha0/electra/HEAD/vocab.txt --------------------------------------------------------------------------------