├── README.md ├── data.py ├── license ├── LICENSE.txt ├── README.md ├── llama_LICENSE.txt └── nanoGPT_LICENSE.txt ├── megabyte.py ├── prepare.py ├── reproduce ├── README.md ├── experiments.ipynb ├── jobs.py └── plots.py ├── requirements.txt ├── rope.py ├── sample.py ├── spacebyte.py ├── spacebyte_figure.svg ├── train.py ├── transformer.py └── util.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/README.md -------------------------------------------------------------------------------- /data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/data.py -------------------------------------------------------------------------------- /license/LICENSE.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/license/LICENSE.txt -------------------------------------------------------------------------------- /license/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/license/README.md -------------------------------------------------------------------------------- /license/llama_LICENSE.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/license/llama_LICENSE.txt -------------------------------------------------------------------------------- /license/nanoGPT_LICENSE.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/license/nanoGPT_LICENSE.txt -------------------------------------------------------------------------------- /megabyte.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/megabyte.py -------------------------------------------------------------------------------- /prepare.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/prepare.py -------------------------------------------------------------------------------- /reproduce/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/reproduce/README.md -------------------------------------------------------------------------------- /reproduce/experiments.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/reproduce/experiments.ipynb -------------------------------------------------------------------------------- /reproduce/jobs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/reproduce/jobs.py -------------------------------------------------------------------------------- /reproduce/plots.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/reproduce/plots.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/requirements.txt -------------------------------------------------------------------------------- /rope.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/rope.py -------------------------------------------------------------------------------- /sample.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/sample.py -------------------------------------------------------------------------------- /spacebyte.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/spacebyte.py -------------------------------------------------------------------------------- /spacebyte_figure.svg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/spacebyte_figure.svg -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/train.py -------------------------------------------------------------------------------- /transformer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/transformer.py -------------------------------------------------------------------------------- /util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kjslag/spacebyte/HEAD/util.py --------------------------------------------------------------------------------