├── .gitignore ├── LICENSE.txt ├── README.md ├── assets ├── SLA_effectiveness.png ├── SLA_efficiency.png ├── SLA_motivation.png └── overview_of_SLA.png ├── evaluate └── bench_kernel.py ├── setup.py └── sparse_linear_attention ├── __init__.py ├── core.py ├── kernel.py └── utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/LICENSE.txt -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/README.md -------------------------------------------------------------------------------- /assets/SLA_effectiveness.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/assets/SLA_effectiveness.png -------------------------------------------------------------------------------- /assets/SLA_efficiency.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/assets/SLA_efficiency.png -------------------------------------------------------------------------------- /assets/SLA_motivation.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/assets/SLA_motivation.png -------------------------------------------------------------------------------- /assets/overview_of_SLA.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/assets/overview_of_SLA.png -------------------------------------------------------------------------------- /evaluate/bench_kernel.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/evaluate/bench_kernel.py -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/setup.py -------------------------------------------------------------------------------- /sparse_linear_attention/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/sparse_linear_attention/__init__.py -------------------------------------------------------------------------------- /sparse_linear_attention/core.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/sparse_linear_attention/core.py -------------------------------------------------------------------------------- /sparse_linear_attention/kernel.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/sparse_linear_attention/kernel.py -------------------------------------------------------------------------------- /sparse_linear_attention/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/thu-ml/SLA/HEAD/sparse_linear_attention/utils.py --------------------------------------------------------------------------------