├── .gitignore ├── README.md ├── eval.txt ├── run_language_model_bert.py ├── run_language_model_ernie.py ├── run_language_model_roberta.py └── train.txt /.gitignore: -------------------------------------------------------------------------------- 1 | cached* 2 | ernie 3 | hflroberta 4 | runs 5 | wandb 6 | output 7 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zhusleep/pytorch_chinese_lm_pretrain/HEAD/README.md -------------------------------------------------------------------------------- /eval.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zhusleep/pytorch_chinese_lm_pretrain/HEAD/eval.txt -------------------------------------------------------------------------------- /run_language_model_bert.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zhusleep/pytorch_chinese_lm_pretrain/HEAD/run_language_model_bert.py -------------------------------------------------------------------------------- /run_language_model_ernie.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zhusleep/pytorch_chinese_lm_pretrain/HEAD/run_language_model_ernie.py -------------------------------------------------------------------------------- /run_language_model_roberta.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zhusleep/pytorch_chinese_lm_pretrain/HEAD/run_language_model_roberta.py -------------------------------------------------------------------------------- /train.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zhusleep/pytorch_chinese_lm_pretrain/HEAD/train.txt --------------------------------------------------------------------------------