├── LICENSE ├── README.md ├── get_data.sh ├── llama2_tokenizer ├── LICENSE.txt ├── README.md ├── gitattributes.txt ├── special_tokens_map.json ├── tokenizer.json ├── tokenizer.model └── tokenizer_config.json ├── loss.png ├── modeling_llama.py ├── process.py ├── run_llms.py ├── run_patch.sh ├── run_token.sh └── wikitext_document_level-test.json /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/README.md -------------------------------------------------------------------------------- /get_data.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/get_data.sh -------------------------------------------------------------------------------- /llama2_tokenizer/LICENSE.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/llama2_tokenizer/LICENSE.txt -------------------------------------------------------------------------------- /llama2_tokenizer/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/llama2_tokenizer/README.md -------------------------------------------------------------------------------- /llama2_tokenizer/gitattributes.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/llama2_tokenizer/gitattributes.txt -------------------------------------------------------------------------------- /llama2_tokenizer/special_tokens_map.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/llama2_tokenizer/special_tokens_map.json -------------------------------------------------------------------------------- /llama2_tokenizer/tokenizer.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/llama2_tokenizer/tokenizer.json -------------------------------------------------------------------------------- /llama2_tokenizer/tokenizer.model: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/llama2_tokenizer/tokenizer.model -------------------------------------------------------------------------------- /llama2_tokenizer/tokenizer_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/llama2_tokenizer/tokenizer_config.json -------------------------------------------------------------------------------- /loss.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/loss.png -------------------------------------------------------------------------------- /modeling_llama.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/modeling_llama.py -------------------------------------------------------------------------------- /process.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/process.py -------------------------------------------------------------------------------- /run_llms.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/run_llms.py -------------------------------------------------------------------------------- /run_patch.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/run_patch.sh -------------------------------------------------------------------------------- /run_token.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/run_token.sh -------------------------------------------------------------------------------- /wikitext_document_level-test.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shaochenze/PatchTrain/HEAD/wikitext_document_level-test.json --------------------------------------------------------------------------------