├── .github └── workflows │ └── python-publish.yml ├── .gitignore ├── LICENSE ├── README.md ├── data ├── README.md └── enwik8.gz ├── setup.py ├── speculative-decoding.png ├── speculative_decoding ├── __init__.py ├── speculative_decoding.py └── speculative_decoding_with_prophet.py ├── train.py ├── train_early_exit.py └── train_prophet.py /.github/workflows/python-publish.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/.github/workflows/python-publish.yml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/README.md -------------------------------------------------------------------------------- /data/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/data/README.md -------------------------------------------------------------------------------- /data/enwik8.gz: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/data/enwik8.gz -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/setup.py -------------------------------------------------------------------------------- /speculative-decoding.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/speculative-decoding.png -------------------------------------------------------------------------------- /speculative_decoding/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/speculative_decoding/__init__.py -------------------------------------------------------------------------------- /speculative_decoding/speculative_decoding.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/speculative_decoding/speculative_decoding.py -------------------------------------------------------------------------------- /speculative_decoding/speculative_decoding_with_prophet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/speculative_decoding/speculative_decoding_with_prophet.py -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/train.py -------------------------------------------------------------------------------- /train_early_exit.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/train_early_exit.py -------------------------------------------------------------------------------- /train_prophet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/lucidrains/speculative-decoding/HEAD/train_prophet.py --------------------------------------------------------------------------------