├── .gitmodules ├── README.md ├── hardware_dict.py ├── media ├── llama2_70b.png └── mistral7b_moe.png ├── model_dict.py ├── models ├── Llama-2-13b │ └── config.json ├── Llama-2-70b │ └── config.json ├── Llama-2-7b │ └── config.json ├── Mixtral_8x7B │ └── config.json └── mistral_7B_v2 │ └── config.json ├── perf_model.py ├── plot_hardware_compare_mesh.py └── roofline.ipynb /.gitmodules: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/.gitmodules -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/README.md -------------------------------------------------------------------------------- /hardware_dict.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/hardware_dict.py -------------------------------------------------------------------------------- /media/llama2_70b.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/media/llama2_70b.png -------------------------------------------------------------------------------- /media/mistral7b_moe.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/media/mistral7b_moe.png -------------------------------------------------------------------------------- /model_dict.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/model_dict.py -------------------------------------------------------------------------------- /models/Llama-2-13b/config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/models/Llama-2-13b/config.json -------------------------------------------------------------------------------- /models/Llama-2-70b/config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/models/Llama-2-70b/config.json -------------------------------------------------------------------------------- /models/Llama-2-7b/config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/models/Llama-2-7b/config.json -------------------------------------------------------------------------------- /models/Mixtral_8x7B/config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/models/Mixtral_8x7B/config.json -------------------------------------------------------------------------------- /models/mistral_7B_v2/config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/models/mistral_7B_v2/config.json -------------------------------------------------------------------------------- /perf_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/perf_model.py -------------------------------------------------------------------------------- /plot_hardware_compare_mesh.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/plot_hardware_compare_mesh.py -------------------------------------------------------------------------------- /roofline.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feifeibear/LLMRoofline/HEAD/roofline.ipynb --------------------------------------------------------------------------------