├── .github └── workflows │ ├── python-publish.yml │ └── python-test.yaml ├── .gitignore ├── LICENSE ├── README.md ├── data ├── README.md └── enwik8.gz ├── diagram.png ├── local_attention ├── __init__.py ├── local_attention.py ├── rotary.py └── transformer.py ├── setup.cfg ├── setup.py ├── tests └── test_local_attention.py └── train.py /.github/workflows/python-publish.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/.github/workflows/python-publish.yml -------------------------------------------------------------------------------- /.github/workflows/python-test.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/.github/workflows/python-test.yaml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/README.md -------------------------------------------------------------------------------- /data/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/data/README.md -------------------------------------------------------------------------------- /data/enwik8.gz: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/data/enwik8.gz -------------------------------------------------------------------------------- /diagram.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/diagram.png -------------------------------------------------------------------------------- /local_attention/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/local_attention/__init__.py -------------------------------------------------------------------------------- /local_attention/local_attention.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/local_attention/local_attention.py -------------------------------------------------------------------------------- /local_attention/rotary.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/local_attention/rotary.py -------------------------------------------------------------------------------- /local_attention/transformer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/local_attention/transformer.py -------------------------------------------------------------------------------- /setup.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/setup.cfg -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/setup.py -------------------------------------------------------------------------------- /tests/test_local_attention.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/tests/test_local_attention.py -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/local-attention/HEAD/train.py --------------------------------------------------------------------------------