├── .gitignore ├── LICENSE ├── README.md ├── environment.yml ├── images └── island.jpeg ├── inference_phi3v_lora.ipynb ├── logs └── .gitkeep ├── model ├── configuration_phi3_v.py ├── image_embedding_phi3_v.py ├── image_processing_phi3_v.py ├── modeling_phi3_v.py ├── processing_phi3_v.py └── sample_inference.py ├── readme └── README_zhcn.md ├── requirements.txt ├── scripts ├── fsdp.yaml ├── train_fsdp.sh ├── train_zero2.sh ├── train_zero3.sh ├── zero2.json └── zero3.json └── train_phi3v.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/README.md -------------------------------------------------------------------------------- /environment.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/environment.yml -------------------------------------------------------------------------------- /images/island.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/images/island.jpeg -------------------------------------------------------------------------------- /inference_phi3v_lora.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/inference_phi3v_lora.ipynb -------------------------------------------------------------------------------- /logs/.gitkeep: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /model/configuration_phi3_v.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/model/configuration_phi3_v.py -------------------------------------------------------------------------------- /model/image_embedding_phi3_v.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/model/image_embedding_phi3_v.py -------------------------------------------------------------------------------- /model/image_processing_phi3_v.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/model/image_processing_phi3_v.py -------------------------------------------------------------------------------- /model/modeling_phi3_v.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/model/modeling_phi3_v.py -------------------------------------------------------------------------------- /model/processing_phi3_v.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/model/processing_phi3_v.py -------------------------------------------------------------------------------- /model/sample_inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/model/sample_inference.py -------------------------------------------------------------------------------- /readme/README_zhcn.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/readme/README_zhcn.md -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/requirements.txt -------------------------------------------------------------------------------- /scripts/fsdp.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/scripts/fsdp.yaml -------------------------------------------------------------------------------- /scripts/train_fsdp.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/scripts/train_fsdp.sh -------------------------------------------------------------------------------- /scripts/train_zero2.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/scripts/train_zero2.sh -------------------------------------------------------------------------------- /scripts/train_zero3.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/scripts/train_zero3.sh -------------------------------------------------------------------------------- /scripts/zero2.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/scripts/zero2.json -------------------------------------------------------------------------------- /scripts/zero3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/scripts/zero3.json -------------------------------------------------------------------------------- /train_phi3v.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GaiZhenbiao/Phi3V-Finetuning/HEAD/train_phi3v.py --------------------------------------------------------------------------------