├── cc-tokenizer.model ├── data.py ├── edit_spm_tokenizer.py ├── gpt.py ├── llama.py ├── mlp.py ├── neox.py ├── sentencepiece_model_pb2.py └── tokenizer.model /cc-tokenizer.model: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cat-state/tinypar/HEAD/cc-tokenizer.model -------------------------------------------------------------------------------- /data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cat-state/tinypar/HEAD/data.py -------------------------------------------------------------------------------- /edit_spm_tokenizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cat-state/tinypar/HEAD/edit_spm_tokenizer.py -------------------------------------------------------------------------------- /gpt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cat-state/tinypar/HEAD/gpt.py -------------------------------------------------------------------------------- /llama.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cat-state/tinypar/HEAD/llama.py -------------------------------------------------------------------------------- /mlp.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cat-state/tinypar/HEAD/mlp.py -------------------------------------------------------------------------------- /neox.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cat-state/tinypar/HEAD/neox.py -------------------------------------------------------------------------------- /sentencepiece_model_pb2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cat-state/tinypar/HEAD/sentencepiece_model_pb2.py -------------------------------------------------------------------------------- /tokenizer.model: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cat-state/tinypar/HEAD/tokenizer.model --------------------------------------------------------------------------------