├── LICENSE ├── configs ├── base.json ├── large.json └── mega.json ├── dataset ├── README.md ├── pre_data.py ├── prepare_data.py └── prepare_data.sh ├── dockerfiles └── gpu-jupyter.Dockerfile ├── example └── example.png ├── readme ├── requirements-gpu.txt ├── requirements-tpu.txt ├── scripts ├── down_gdrive_file.py └── interactive_conditional_samples.py ├── tokenization ├── __init__.py ├── bert-base-chinese-vocab.txt ├── bert-large-cased-whole-word-masking-vocab.txt └── tokenization.py ├── train ├── __init__.py ├── dataloader.py ├── modeling.py ├── optimization_adafactor.py ├── train_tpu_adafactor.sh ├── train_wc.py └── utils.py └── utils.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/LICENSE -------------------------------------------------------------------------------- /configs/base.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/configs/base.json -------------------------------------------------------------------------------- /configs/large.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/configs/large.json -------------------------------------------------------------------------------- /configs/mega.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/configs/mega.json -------------------------------------------------------------------------------- /dataset/README.md: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /dataset/pre_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/dataset/pre_data.py -------------------------------------------------------------------------------- /dataset/prepare_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/dataset/prepare_data.py -------------------------------------------------------------------------------- /dataset/prepare_data.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/dataset/prepare_data.sh -------------------------------------------------------------------------------- /dockerfiles/gpu-jupyter.Dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/dockerfiles/gpu-jupyter.Dockerfile -------------------------------------------------------------------------------- /example/example.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/example/example.png -------------------------------------------------------------------------------- /readme: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/readme -------------------------------------------------------------------------------- /requirements-gpu.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/requirements-gpu.txt -------------------------------------------------------------------------------- /requirements-tpu.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/requirements-tpu.txt -------------------------------------------------------------------------------- /scripts/down_gdrive_file.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/scripts/down_gdrive_file.py -------------------------------------------------------------------------------- /scripts/interactive_conditional_samples.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/scripts/interactive_conditional_samples.py -------------------------------------------------------------------------------- /tokenization/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tokenization/bert-base-chinese-vocab.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/tokenization/bert-base-chinese-vocab.txt -------------------------------------------------------------------------------- /tokenization/bert-large-cased-whole-word-masking-vocab.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/tokenization/bert-large-cased-whole-word-masking-vocab.txt -------------------------------------------------------------------------------- /tokenization/tokenization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/tokenization/tokenization.py -------------------------------------------------------------------------------- /train/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /train/dataloader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/train/dataloader.py -------------------------------------------------------------------------------- /train/modeling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/train/modeling.py -------------------------------------------------------------------------------- /train/optimization_adafactor.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/train/optimization_adafactor.py -------------------------------------------------------------------------------- /train/train_tpu_adafactor.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/train/train_tpu_adafactor.sh -------------------------------------------------------------------------------- /train/train_wc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/train/train_wc.py -------------------------------------------------------------------------------- /train/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/train/utils.py -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wind91725/gpt2-ml-finetune-/HEAD/utils.py --------------------------------------------------------------------------------