├── .github ├── ISSUE_TEMPLATE │ ├── bug_report.md │ ├── discussion.md │ └── feature_request.md ├── demo.png ├── logo.png ├── logo.svg ├── loss.png └── stale.yml ├── .gitignore ├── .idea ├── .gitignore ├── gpt2-ml-fixed.iml ├── inspectionProfiles │ └── profiles_settings.xml ├── misc.xml ├── modules.xml └── vcs.xml ├── 3rd └── gdown.pl │ ├── LICENSE.txt │ ├── README.md │ └── gdown.pl ├── LICENSE ├── README.md ├── README_CN.md ├── colabVersionCheck.ipynb ├── configs ├── base.json ├── large.json └── mega.json ├── dataset ├── README.md ├── prepare_data.py └── prepare_data.sh ├── dockerfiles └── gpu-jupyter.Dockerfile ├── gpt2_ml_fixed.ipynb ├── pretrained_model_demo.ipynb ├── requirements-gpu.txt ├── requirements-tpu.txt ├── scripts ├── demo.py └── down_gdrive_file.py ├── tokenization ├── __init__.py ├── bert-base-chinese-vocab.txt ├── bert-large-cased-whole-word-masking-vocab.txt ├── clue-vocab.txt └── tokenization.py ├── train ├── __init__.py ├── dataloader.py ├── modeling.py ├── optimization_adafactor.py ├── train_tpu.py ├── train_tpu_adafactor.sh └── utils.py └── verchk.ipynb /.github/ISSUE_TEMPLATE/bug_report.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.github/ISSUE_TEMPLATE/bug_report.md -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/discussion.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.github/ISSUE_TEMPLATE/discussion.md -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/feature_request.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.github/ISSUE_TEMPLATE/feature_request.md -------------------------------------------------------------------------------- /.github/demo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.github/demo.png -------------------------------------------------------------------------------- /.github/logo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.github/logo.png -------------------------------------------------------------------------------- /.github/logo.svg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.github/logo.svg -------------------------------------------------------------------------------- /.github/loss.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.github/loss.png -------------------------------------------------------------------------------- /.github/stale.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.github/stale.yml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.gitignore -------------------------------------------------------------------------------- /.idea/.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.idea/.gitignore -------------------------------------------------------------------------------- /.idea/gpt2-ml-fixed.iml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.idea/gpt2-ml-fixed.iml -------------------------------------------------------------------------------- /.idea/inspectionProfiles/profiles_settings.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.idea/inspectionProfiles/profiles_settings.xml -------------------------------------------------------------------------------- /.idea/misc.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.idea/misc.xml -------------------------------------------------------------------------------- /.idea/modules.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.idea/modules.xml -------------------------------------------------------------------------------- /.idea/vcs.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/.idea/vcs.xml -------------------------------------------------------------------------------- /3rd/gdown.pl/LICENSE.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/3rd/gdown.pl/LICENSE.txt -------------------------------------------------------------------------------- /3rd/gdown.pl/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/3rd/gdown.pl/README.md -------------------------------------------------------------------------------- /3rd/gdown.pl/gdown.pl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/3rd/gdown.pl/gdown.pl -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/README.md -------------------------------------------------------------------------------- /README_CN.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/README_CN.md -------------------------------------------------------------------------------- /colabVersionCheck.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/colabVersionCheck.ipynb -------------------------------------------------------------------------------- /configs/base.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/configs/base.json -------------------------------------------------------------------------------- /configs/large.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/configs/large.json -------------------------------------------------------------------------------- /configs/mega.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/configs/mega.json -------------------------------------------------------------------------------- /dataset/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/dataset/README.md -------------------------------------------------------------------------------- /dataset/prepare_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/dataset/prepare_data.py -------------------------------------------------------------------------------- /dataset/prepare_data.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/dataset/prepare_data.sh -------------------------------------------------------------------------------- /dockerfiles/gpu-jupyter.Dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/dockerfiles/gpu-jupyter.Dockerfile -------------------------------------------------------------------------------- /gpt2_ml_fixed.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/gpt2_ml_fixed.ipynb -------------------------------------------------------------------------------- /pretrained_model_demo.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/pretrained_model_demo.ipynb -------------------------------------------------------------------------------- /requirements-gpu.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/requirements-gpu.txt -------------------------------------------------------------------------------- /requirements-tpu.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/requirements-tpu.txt -------------------------------------------------------------------------------- /scripts/demo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/scripts/demo.py -------------------------------------------------------------------------------- /scripts/down_gdrive_file.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/scripts/down_gdrive_file.py -------------------------------------------------------------------------------- /tokenization/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tokenization/bert-base-chinese-vocab.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/tokenization/bert-base-chinese-vocab.txt -------------------------------------------------------------------------------- /tokenization/bert-large-cased-whole-word-masking-vocab.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/tokenization/bert-large-cased-whole-word-masking-vocab.txt -------------------------------------------------------------------------------- /tokenization/clue-vocab.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/tokenization/clue-vocab.txt -------------------------------------------------------------------------------- /tokenization/tokenization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/tokenization/tokenization.py -------------------------------------------------------------------------------- /train/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /train/dataloader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/train/dataloader.py -------------------------------------------------------------------------------- /train/modeling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/train/modeling.py -------------------------------------------------------------------------------- /train/optimization_adafactor.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/train/optimization_adafactor.py -------------------------------------------------------------------------------- /train/train_tpu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/train/train_tpu.py -------------------------------------------------------------------------------- /train/train_tpu_adafactor.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/train/train_tpu_adafactor.sh -------------------------------------------------------------------------------- /train/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/train/utils.py -------------------------------------------------------------------------------- /verchk.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zxkmm/gpt2-ml-fixed/HEAD/verchk.ipynb --------------------------------------------------------------------------------