├── README.md ├── infer.py ├── modeling ├── __init__.py ├── configuration_moe.py └── modeling_moe.py └── pics ├── effcient_inference.png ├── effcient_training.png └── evaluation_res.png /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ZhenweiAn/Dynamic_MoE/HEAD/README.md -------------------------------------------------------------------------------- /infer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ZhenweiAn/Dynamic_MoE/HEAD/infer.py -------------------------------------------------------------------------------- /modeling/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /modeling/configuration_moe.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ZhenweiAn/Dynamic_MoE/HEAD/modeling/configuration_moe.py -------------------------------------------------------------------------------- /modeling/modeling_moe.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ZhenweiAn/Dynamic_MoE/HEAD/modeling/modeling_moe.py -------------------------------------------------------------------------------- /pics/effcient_inference.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ZhenweiAn/Dynamic_MoE/HEAD/pics/effcient_inference.png -------------------------------------------------------------------------------- /pics/effcient_training.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ZhenweiAn/Dynamic_MoE/HEAD/pics/effcient_training.png -------------------------------------------------------------------------------- /pics/evaluation_res.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ZhenweiAn/Dynamic_MoE/HEAD/pics/evaluation_res.png --------------------------------------------------------------------------------