├── LICENSE ├── README.md ├── README_zh.md ├── assets ├── Megrez_Omni_Technical_Report.pdf ├── github-mark.png ├── gradio_demo.jpg ├── megrez_logo.png ├── multitask.jpg ├── opencompass.jpg ├── wechat-group.jpg ├── wechat-official.jpg └── wechat.jpg ├── data ├── sample_audio.mp3 ├── sample_image.jpg └── train │ ├── audios │ ├── 0_0_0_chattts.wav │ ├── 0_1_0_chattts.wav │ ├── 0_2_0_chattts.wav │ ├── 0_3_0_chattts.wav │ ├── 0_4_0_chattts.wav │ ├── 0_5_0_chattts.wav │ ├── 0_6_0_chattts.wav │ ├── 0_7_0_chattts.wav │ ├── 2_0_0_chattts.wav │ └── 3_0_0_chattts.wav │ ├── images │ ├── 100223054.jpeg │ ├── 100230144.jpeg │ ├── 100234216.jpeg │ ├── 100245026.jpeg │ ├── 100271334.jpeg │ ├── 100277305.jpeg │ ├── 100280844.jpeg │ ├── 100284327.jpeg │ ├── 104042.jpeg │ └── 10688.jpeg │ └── records.jsonl ├── example_chat_hf.py ├── finetune ├── dataset.py ├── ds_config_zero2.json ├── finetune.py ├── finetune.sh ├── requirements.txt └── trainer.py ├── gradio_app.py ├── requirements.txt └── vllm_demo ├── __pycache__ └── megrezo.cpython-310.pyc ├── example_infer_vllm.py ├── megrezo.py ├── requirements.txt ├── try_minicpm_v.py ├── try_qwen_vl.py ├── vllm_profling.py ├── vllm_profling_minicpm.py └── vllm_profling_qwen.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/README.md -------------------------------------------------------------------------------- /README_zh.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/README_zh.md -------------------------------------------------------------------------------- /assets/Megrez_Omni_Technical_Report.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/assets/Megrez_Omni_Technical_Report.pdf -------------------------------------------------------------------------------- /assets/github-mark.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/assets/github-mark.png -------------------------------------------------------------------------------- /assets/gradio_demo.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/assets/gradio_demo.jpg -------------------------------------------------------------------------------- /assets/megrez_logo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/assets/megrez_logo.png -------------------------------------------------------------------------------- /assets/multitask.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/assets/multitask.jpg -------------------------------------------------------------------------------- /assets/opencompass.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/assets/opencompass.jpg -------------------------------------------------------------------------------- /assets/wechat-group.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/assets/wechat-group.jpg -------------------------------------------------------------------------------- /assets/wechat-official.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/assets/wechat-official.jpg -------------------------------------------------------------------------------- /assets/wechat.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/assets/wechat.jpg -------------------------------------------------------------------------------- /data/sample_audio.mp3: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/sample_audio.mp3 -------------------------------------------------------------------------------- /data/sample_image.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/sample_image.jpg -------------------------------------------------------------------------------- /data/train/audios/0_0_0_chattts.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/audios/0_0_0_chattts.wav -------------------------------------------------------------------------------- /data/train/audios/0_1_0_chattts.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/audios/0_1_0_chattts.wav -------------------------------------------------------------------------------- /data/train/audios/0_2_0_chattts.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/audios/0_2_0_chattts.wav -------------------------------------------------------------------------------- /data/train/audios/0_3_0_chattts.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/audios/0_3_0_chattts.wav -------------------------------------------------------------------------------- /data/train/audios/0_4_0_chattts.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/audios/0_4_0_chattts.wav -------------------------------------------------------------------------------- /data/train/audios/0_5_0_chattts.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/audios/0_5_0_chattts.wav -------------------------------------------------------------------------------- /data/train/audios/0_6_0_chattts.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/audios/0_6_0_chattts.wav -------------------------------------------------------------------------------- /data/train/audios/0_7_0_chattts.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/audios/0_7_0_chattts.wav -------------------------------------------------------------------------------- /data/train/audios/2_0_0_chattts.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/audios/2_0_0_chattts.wav -------------------------------------------------------------------------------- /data/train/audios/3_0_0_chattts.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/audios/3_0_0_chattts.wav -------------------------------------------------------------------------------- /data/train/images/100223054.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/images/100223054.jpeg -------------------------------------------------------------------------------- /data/train/images/100230144.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/images/100230144.jpeg -------------------------------------------------------------------------------- /data/train/images/100234216.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/images/100234216.jpeg -------------------------------------------------------------------------------- /data/train/images/100245026.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/images/100245026.jpeg -------------------------------------------------------------------------------- /data/train/images/100271334.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/images/100271334.jpeg -------------------------------------------------------------------------------- /data/train/images/100277305.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/images/100277305.jpeg -------------------------------------------------------------------------------- /data/train/images/100280844.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/images/100280844.jpeg -------------------------------------------------------------------------------- /data/train/images/100284327.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/images/100284327.jpeg -------------------------------------------------------------------------------- /data/train/images/104042.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/images/104042.jpeg -------------------------------------------------------------------------------- /data/train/images/10688.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/images/10688.jpeg -------------------------------------------------------------------------------- /data/train/records.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/data/train/records.jsonl -------------------------------------------------------------------------------- /example_chat_hf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/example_chat_hf.py -------------------------------------------------------------------------------- /finetune/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/finetune/dataset.py -------------------------------------------------------------------------------- /finetune/ds_config_zero2.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/finetune/ds_config_zero2.json -------------------------------------------------------------------------------- /finetune/finetune.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/finetune/finetune.py -------------------------------------------------------------------------------- /finetune/finetune.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/finetune/finetune.sh -------------------------------------------------------------------------------- /finetune/requirements.txt: -------------------------------------------------------------------------------- 1 | deepspeed 2 | accelerate -------------------------------------------------------------------------------- /finetune/trainer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/finetune/trainer.py -------------------------------------------------------------------------------- /gradio_app.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/gradio_app.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/requirements.txt -------------------------------------------------------------------------------- /vllm_demo/__pycache__/megrezo.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/vllm_demo/__pycache__/megrezo.cpython-310.pyc -------------------------------------------------------------------------------- /vllm_demo/example_infer_vllm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/vllm_demo/example_infer_vllm.py -------------------------------------------------------------------------------- /vllm_demo/megrezo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/vllm_demo/megrezo.py -------------------------------------------------------------------------------- /vllm_demo/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/vllm_demo/requirements.txt -------------------------------------------------------------------------------- /vllm_demo/try_minicpm_v.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/vllm_demo/try_minicpm_v.py -------------------------------------------------------------------------------- /vllm_demo/try_qwen_vl.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/vllm_demo/try_qwen_vl.py -------------------------------------------------------------------------------- /vllm_demo/vllm_profling.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/vllm_demo/vllm_profling.py -------------------------------------------------------------------------------- /vllm_demo/vllm_profling_minicpm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/vllm_demo/vllm_profling_minicpm.py -------------------------------------------------------------------------------- /vllm_demo/vllm_profling_qwen.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/infinigence/Infini-Megrez-Omni/HEAD/vllm_demo/vllm_profling_qwen.py --------------------------------------------------------------------------------