├── 20B_tokenizer.json ├── ChatRWKV.png ├── LICENSE ├── README.md ├── RWKV-eval.png ├── benchmark.py ├── chat.py ├── chat_interpretability.py ├── chat_onnx.py ├── requirements.txt ├── src ├── model_run.py └── utils.py └── test.py /20B_tokenizer.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/20B_tokenizer.json -------------------------------------------------------------------------------- /ChatRWKV.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/ChatRWKV.png -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/README.md -------------------------------------------------------------------------------- /RWKV-eval.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/RWKV-eval.png -------------------------------------------------------------------------------- /benchmark.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/benchmark.py -------------------------------------------------------------------------------- /chat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/chat.py -------------------------------------------------------------------------------- /chat_interpretability.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/chat_interpretability.py -------------------------------------------------------------------------------- /chat_onnx.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/chat_onnx.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | torch==1.13.1 2 | tokenizers>=0.13.2 -------------------------------------------------------------------------------- /src/model_run.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/src/model_run.py -------------------------------------------------------------------------------- /src/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/src/utils.py -------------------------------------------------------------------------------- /test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/UnstoppableCurry/RWKV-LM-Interpretability-Research/HEAD/test.py --------------------------------------------------------------------------------