├── .gitignore ├── README.md ├── assets ├── all_layers_avg_llama.jpg ├── all_layers_avg_llama_ignore_first_token.jpg ├── all_layers_avg_llama_w_4_a_4.jpg ├── all_layers_avg_llama_w_4_a_8.jpg └── layer_0_llama.jpg ├── attn_viewer ├── __init__.py ├── core.py └── plot_utils.py ├── main.py ├── main_quant.py ├── requirements.txt └── setup.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/README.md -------------------------------------------------------------------------------- /assets/all_layers_avg_llama.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/assets/all_layers_avg_llama.jpg -------------------------------------------------------------------------------- /assets/all_layers_avg_llama_ignore_first_token.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/assets/all_layers_avg_llama_ignore_first_token.jpg -------------------------------------------------------------------------------- /assets/all_layers_avg_llama_w_4_a_4.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/assets/all_layers_avg_llama_w_4_a_4.jpg -------------------------------------------------------------------------------- /assets/all_layers_avg_llama_w_4_a_8.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/assets/all_layers_avg_llama_w_4_a_8.jpg -------------------------------------------------------------------------------- /assets/layer_0_llama.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/assets/layer_0_llama.jpg -------------------------------------------------------------------------------- /attn_viewer/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /attn_viewer/core.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/attn_viewer/core.py -------------------------------------------------------------------------------- /attn_viewer/plot_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/attn_viewer/plot_utils.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/main.py -------------------------------------------------------------------------------- /main_quant.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/main_quant.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/requirements.txt -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/wln20/Attention-Viewer/HEAD/setup.py --------------------------------------------------------------------------------