├── CITATION.cff ├── LICENSE ├── README.md ├── XrayGLM_inference.ipynb ├── assets ├── images │ ├── hx.png │ ├── mpu.png │ ├── web_demo.png │ └── xrayglm.png └── train_cli.txt ├── checkpoints └── README.md ├── cli_demo.py ├── data ├── Xray │ ├── 2577_1.png │ ├── 2882_1.png │ ├── 2_1.png │ ├── 2_2.png │ ├── 861_1.png │ └── openi-zh.json ├── build_ch_prompt-random.py ├── build_ch_prompt.py ├── build_images_data.py ├── demo │ ├── 2p.png │ ├── dataset.json │ ├── ghost.jpg │ ├── justice.png │ ├── katong.png │ ├── kobe.png │ ├── man.jpg │ ├── meme.png │ ├── music.png │ ├── panda.jpg │ ├── passport.png │ ├── pattern.png │ ├── pig.png │ ├── push.png │ ├── rou.png │ ├── rub.png │ ├── tianye.png │ ├── titan.png │ ├── tower.png │ ├── traf.png │ └── woman.png ├── from_xml_get_images_id.py ├── json2md.py ├── merge_ch2json.py ├── openi-ch-random.json ├── openi-en.json └── translation_en2zh.py ├── finetune_XrayGLM.py ├── finetune_XrayGLM.sh ├── lora_mixin.py ├── model ├── __init__.py ├── blip2.py ├── chat.py ├── infer_util.py └── visualglm.py ├── requirements.txt ├── requirements_wo_ds.txt └── web_demo.py /CITATION.cff: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/CITATION.cff -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/README.md -------------------------------------------------------------------------------- /XrayGLM_inference.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/XrayGLM_inference.ipynb -------------------------------------------------------------------------------- /assets/images/hx.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/assets/images/hx.png -------------------------------------------------------------------------------- /assets/images/mpu.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/assets/images/mpu.png -------------------------------------------------------------------------------- /assets/images/web_demo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/assets/images/web_demo.png -------------------------------------------------------------------------------- /assets/images/xrayglm.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/assets/images/xrayglm.png -------------------------------------------------------------------------------- /assets/train_cli.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/assets/train_cli.txt -------------------------------------------------------------------------------- /checkpoints/README.md: -------------------------------------------------------------------------------- 1 | 下载模型权重放在这里 -------------------------------------------------------------------------------- /cli_demo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/cli_demo.py -------------------------------------------------------------------------------- /data/Xray/2577_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/Xray/2577_1.png -------------------------------------------------------------------------------- /data/Xray/2882_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/Xray/2882_1.png -------------------------------------------------------------------------------- /data/Xray/2_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/Xray/2_1.png -------------------------------------------------------------------------------- /data/Xray/2_2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/Xray/2_2.png -------------------------------------------------------------------------------- /data/Xray/861_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/Xray/861_1.png -------------------------------------------------------------------------------- /data/Xray/openi-zh.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/Xray/openi-zh.json -------------------------------------------------------------------------------- /data/build_ch_prompt-random.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/build_ch_prompt-random.py -------------------------------------------------------------------------------- /data/build_ch_prompt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/build_ch_prompt.py -------------------------------------------------------------------------------- /data/build_images_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/build_images_data.py -------------------------------------------------------------------------------- /data/demo/2p.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/2p.png -------------------------------------------------------------------------------- /data/demo/dataset.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/dataset.json -------------------------------------------------------------------------------- /data/demo/ghost.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/ghost.jpg -------------------------------------------------------------------------------- /data/demo/justice.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/justice.png -------------------------------------------------------------------------------- /data/demo/katong.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/katong.png -------------------------------------------------------------------------------- /data/demo/kobe.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/kobe.png -------------------------------------------------------------------------------- /data/demo/man.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/man.jpg -------------------------------------------------------------------------------- /data/demo/meme.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/meme.png -------------------------------------------------------------------------------- /data/demo/music.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/music.png -------------------------------------------------------------------------------- /data/demo/panda.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/panda.jpg -------------------------------------------------------------------------------- /data/demo/passport.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/passport.png -------------------------------------------------------------------------------- /data/demo/pattern.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/pattern.png -------------------------------------------------------------------------------- /data/demo/pig.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/pig.png -------------------------------------------------------------------------------- /data/demo/push.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/push.png -------------------------------------------------------------------------------- /data/demo/rou.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/rou.png -------------------------------------------------------------------------------- /data/demo/rub.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/rub.png -------------------------------------------------------------------------------- /data/demo/tianye.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/tianye.png -------------------------------------------------------------------------------- /data/demo/titan.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/titan.png -------------------------------------------------------------------------------- /data/demo/tower.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/tower.png -------------------------------------------------------------------------------- /data/demo/traf.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/traf.png -------------------------------------------------------------------------------- /data/demo/woman.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/demo/woman.png -------------------------------------------------------------------------------- /data/from_xml_get_images_id.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/from_xml_get_images_id.py -------------------------------------------------------------------------------- /data/json2md.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/json2md.py -------------------------------------------------------------------------------- /data/merge_ch2json.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/merge_ch2json.py -------------------------------------------------------------------------------- /data/openi-ch-random.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/openi-ch-random.json -------------------------------------------------------------------------------- /data/openi-en.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/openi-en.json -------------------------------------------------------------------------------- /data/translation_en2zh.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/data/translation_en2zh.py -------------------------------------------------------------------------------- /finetune_XrayGLM.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/finetune_XrayGLM.py -------------------------------------------------------------------------------- /finetune_XrayGLM.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/finetune_XrayGLM.sh -------------------------------------------------------------------------------- /lora_mixin.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/lora_mixin.py -------------------------------------------------------------------------------- /model/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/model/__init__.py -------------------------------------------------------------------------------- /model/blip2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/model/blip2.py -------------------------------------------------------------------------------- /model/chat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/model/chat.py -------------------------------------------------------------------------------- /model/infer_util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/model/infer_util.py -------------------------------------------------------------------------------- /model/visualglm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/model/visualglm.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/requirements.txt -------------------------------------------------------------------------------- /requirements_wo_ds.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/requirements_wo_ds.txt -------------------------------------------------------------------------------- /web_demo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WangRongsheng/XrayGLM/HEAD/web_demo.py --------------------------------------------------------------------------------