├── .gitignore ├── LICENSE ├── README.md ├── rope_test.ipynb └── util ├── amp_wrapper.py ├── autograd_4bit.py ├── dope_llama_monkey_patch.py ├── flash_attention_llama_monkey_patch.py ├── matmul_utils_4bit.py ├── peft_tuners_lora_monkey_patch.py └── xpos_rope_llama_monkey_patch.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/README.md -------------------------------------------------------------------------------- /rope_test.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/rope_test.ipynb -------------------------------------------------------------------------------- /util/amp_wrapper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/util/amp_wrapper.py -------------------------------------------------------------------------------- /util/autograd_4bit.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/util/autograd_4bit.py -------------------------------------------------------------------------------- /util/dope_llama_monkey_patch.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/util/dope_llama_monkey_patch.py -------------------------------------------------------------------------------- /util/flash_attention_llama_monkey_patch.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/util/flash_attention_llama_monkey_patch.py -------------------------------------------------------------------------------- /util/matmul_utils_4bit.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/util/matmul_utils_4bit.py -------------------------------------------------------------------------------- /util/peft_tuners_lora_monkey_patch.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/util/peft_tuners_lora_monkey_patch.py -------------------------------------------------------------------------------- /util/xpos_rope_llama_monkey_patch.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kaiokendev/cutoff-len-is-context-len/HEAD/util/xpos_rope_llama_monkey_patch.py --------------------------------------------------------------------------------