├── LAVIS_tool ├── README.md ├── _lavis_img2txt.py ├── _train_adv_img_query.py ├── _train_adv_img_trans.py ├── bash_adv_img_query.sh ├── bash_adv_img_trans.sh ├── bash_img2txt_blip.sh └── bash_img2txt_blip2.sh ├── LICENSE ├── MiniGPT-4 ├── README.md ├── _minigpt4_img2txt.py ├── _minigpt4_img2txt.sh ├── _train_adv_img_query.py ├── _train_adv_img_query.sh ├── _train_adv_img_trans.py └── _train_adv_img_trans.sh ├── README.md ├── assets ├── IMG3425_703_vis.jpg ├── example.png ├── teaser_1.jpg ├── teaser_2.jpg ├── teaser_3.jpg └── teaser_4.jpg ├── environment.yaml ├── eval_clip_text_score.py └── unidiff_tool ├── _eval_adv_img_i2t.py ├── _eval_i2t_dataset.py ├── _train_adv_img_trans.py ├── _train_adv_img_trans.sh ├── _train_trans_and_query_fixed_budget.py ├── _train_trans_and_query_fixed_budget.sh ├── _train_trans_and_query_more_budget.py ├── _train_trans_and_query_more_budget.sh ├── eval_i2t_batch.py └── visualize_diff.py /LAVIS_tool/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/LAVIS_tool/README.md -------------------------------------------------------------------------------- /LAVIS_tool/_lavis_img2txt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/LAVIS_tool/_lavis_img2txt.py -------------------------------------------------------------------------------- /LAVIS_tool/_train_adv_img_query.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/LAVIS_tool/_train_adv_img_query.py -------------------------------------------------------------------------------- /LAVIS_tool/_train_adv_img_trans.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/LAVIS_tool/_train_adv_img_trans.py -------------------------------------------------------------------------------- /LAVIS_tool/bash_adv_img_query.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/LAVIS_tool/bash_adv_img_query.sh -------------------------------------------------------------------------------- /LAVIS_tool/bash_adv_img_trans.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/LAVIS_tool/bash_adv_img_trans.sh -------------------------------------------------------------------------------- /LAVIS_tool/bash_img2txt_blip.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/LAVIS_tool/bash_img2txt_blip.sh -------------------------------------------------------------------------------- /LAVIS_tool/bash_img2txt_blip2.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/LAVIS_tool/bash_img2txt_blip2.sh -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/LICENSE -------------------------------------------------------------------------------- /MiniGPT-4/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/MiniGPT-4/README.md -------------------------------------------------------------------------------- /MiniGPT-4/_minigpt4_img2txt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/MiniGPT-4/_minigpt4_img2txt.py -------------------------------------------------------------------------------- /MiniGPT-4/_minigpt4_img2txt.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/MiniGPT-4/_minigpt4_img2txt.sh -------------------------------------------------------------------------------- /MiniGPT-4/_train_adv_img_query.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/MiniGPT-4/_train_adv_img_query.py -------------------------------------------------------------------------------- /MiniGPT-4/_train_adv_img_query.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/MiniGPT-4/_train_adv_img_query.sh -------------------------------------------------------------------------------- /MiniGPT-4/_train_adv_img_trans.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/MiniGPT-4/_train_adv_img_trans.py -------------------------------------------------------------------------------- /MiniGPT-4/_train_adv_img_trans.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/MiniGPT-4/_train_adv_img_trans.sh -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/README.md -------------------------------------------------------------------------------- /assets/IMG3425_703_vis.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/assets/IMG3425_703_vis.jpg -------------------------------------------------------------------------------- /assets/example.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/assets/example.png -------------------------------------------------------------------------------- /assets/teaser_1.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/assets/teaser_1.jpg -------------------------------------------------------------------------------- /assets/teaser_2.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/assets/teaser_2.jpg -------------------------------------------------------------------------------- /assets/teaser_3.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/assets/teaser_3.jpg -------------------------------------------------------------------------------- /assets/teaser_4.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/assets/teaser_4.jpg -------------------------------------------------------------------------------- /environment.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/environment.yaml -------------------------------------------------------------------------------- /eval_clip_text_score.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/eval_clip_text_score.py -------------------------------------------------------------------------------- /unidiff_tool/_eval_adv_img_i2t.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/unidiff_tool/_eval_adv_img_i2t.py -------------------------------------------------------------------------------- /unidiff_tool/_eval_i2t_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/unidiff_tool/_eval_i2t_dataset.py -------------------------------------------------------------------------------- /unidiff_tool/_train_adv_img_trans.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/unidiff_tool/_train_adv_img_trans.py -------------------------------------------------------------------------------- /unidiff_tool/_train_adv_img_trans.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/unidiff_tool/_train_adv_img_trans.sh -------------------------------------------------------------------------------- /unidiff_tool/_train_trans_and_query_fixed_budget.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/unidiff_tool/_train_trans_and_query_fixed_budget.py -------------------------------------------------------------------------------- /unidiff_tool/_train_trans_and_query_fixed_budget.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/unidiff_tool/_train_trans_and_query_fixed_budget.sh -------------------------------------------------------------------------------- /unidiff_tool/_train_trans_and_query_more_budget.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/unidiff_tool/_train_trans_and_query_more_budget.py -------------------------------------------------------------------------------- /unidiff_tool/_train_trans_and_query_more_budget.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/unidiff_tool/_train_trans_and_query_more_budget.sh -------------------------------------------------------------------------------- /unidiff_tool/eval_i2t_batch.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/unidiff_tool/eval_i2t_batch.py -------------------------------------------------------------------------------- /unidiff_tool/visualize_diff.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yunqing-me/AttackVLM/HEAD/unidiff_tool/visualize_diff.py --------------------------------------------------------------------------------