├── LICENSE ├── README.md ├── README_EN.md ├── assets ├── megrez-logo.png ├── wechat-group.jpg └── wechat-official.jpg ├── demo ├── infer_hf_offline.py ├── sglang │ ├── infer_sglang_offline.py │ ├── megrez_moe.py │ └── patch │ │ └── layer.py └── vllm │ ├── infer_vllm_offline.py │ ├── megrez_moe.py │ ├── patch │ └── layer.py │ └── serve_llm_online.py ├── docs └── tech_report.pdf └── requirements.txt /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/README.md -------------------------------------------------------------------------------- /README_EN.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/README_EN.md -------------------------------------------------------------------------------- /assets/megrez-logo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/assets/megrez-logo.png -------------------------------------------------------------------------------- /assets/wechat-group.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/assets/wechat-group.jpg -------------------------------------------------------------------------------- /assets/wechat-official.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/assets/wechat-official.jpg -------------------------------------------------------------------------------- /demo/infer_hf_offline.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/demo/infer_hf_offline.py -------------------------------------------------------------------------------- /demo/sglang/infer_sglang_offline.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/demo/sglang/infer_sglang_offline.py -------------------------------------------------------------------------------- /demo/sglang/megrez_moe.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/demo/sglang/megrez_moe.py -------------------------------------------------------------------------------- /demo/sglang/patch/layer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/demo/sglang/patch/layer.py -------------------------------------------------------------------------------- /demo/vllm/infer_vllm_offline.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/demo/vllm/infer_vllm_offline.py -------------------------------------------------------------------------------- /demo/vllm/megrez_moe.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/demo/vllm/megrez_moe.py -------------------------------------------------------------------------------- /demo/vllm/patch/layer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/demo/vllm/patch/layer.py -------------------------------------------------------------------------------- /demo/vllm/serve_llm_online.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/demo/vllm/serve_llm_online.py -------------------------------------------------------------------------------- /docs/tech_report.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/docs/tech_report.pdf -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez/HEAD/requirements.txt --------------------------------------------------------------------------------