├── .gitignore ├── GPT4V_ZS.py ├── GPT4V_ZS_Results ├── aircraft.json ├── caltech101.json ├── car.json ├── dtd.json ├── eurosat.json ├── flower102.json ├── food101.json ├── hmdb_8frame.json ├── imagenet.json ├── k400.json ├── modelnet10_front.json ├── pets.json ├── rafdb.json ├── sun397.json └── ucf_8frame.json ├── GPT4_generated_prompts ├── aircraft_20_prompts_0_100_api.json ├── caltech101_20_prompts_0_101_api.json ├── dtd_20_prompts_0_47_api.json ├── eurosat_20_prompts.json ├── flower102_20_prompts_api.json ├── food101_20_prompts_0_101_api.json ├── hmdb_20_prompts_0_51_api.json ├── imagenet_20_prompts_0_1000_api.json ├── k400_20_prompts_0_400_api.json ├── modelnet10_20_prompts_0_10_api.json ├── pets_20_prompts_0_37_api.json ├── raf_db_20_prompts.json ├── ssv1_20_prompts_0_174_api.json ├── stanford_car_20_prompts_0_196_api.json ├── sun397_20_prompts_0_397_api.json └── ucf_20_prompts.json ├── LICENSE ├── README.md ├── annotations ├── aircraft_gt.json ├── caltech101_gt.json ├── dtd_gt.json ├── eurosat_gt.json ├── flower102_gt.json ├── food_gt.json ├── hmdb_gt.json ├── imagenet_gt.json ├── k400_gt.json ├── modelnet10_gt.json ├── pets_gt.json ├── rafdb_gt.json ├── stanford_cars_gt.json ├── sun397_gt.json └── ucf_gt.json ├── calculate_acc.py ├── config ├── aircraft.yaml ├── caltech101.yaml ├── dtd.yaml ├── eurosat.yaml ├── flower102.yaml ├── food101.yaml ├── hmdb.yaml ├── imagenet.yaml ├── k400.yaml ├── pets.yaml ├── raf_db.yaml ├── ssv1.yaml ├── stanford_car.yaml ├── sun397.yaml └── ucf.yaml ├── config_path.py ├── docs ├── datasets.png ├── generated_sentences.png ├── gpt4v_prompt.png ├── method.png └── results.jpg └── generate_prompt.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/.gitignore -------------------------------------------------------------------------------- /GPT4V_ZS.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS.py -------------------------------------------------------------------------------- /GPT4V_ZS_Results/aircraft.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/aircraft.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/caltech101.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/caltech101.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/car.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/car.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/dtd.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/dtd.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/eurosat.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/eurosat.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/flower102.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/flower102.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/food101.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/food101.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/hmdb_8frame.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/hmdb_8frame.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/imagenet.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/imagenet.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/k400.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/k400.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/modelnet10_front.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/modelnet10_front.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/pets.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/pets.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/rafdb.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/rafdb.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/sun397.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/sun397.json -------------------------------------------------------------------------------- /GPT4V_ZS_Results/ucf_8frame.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4V_ZS_Results/ucf_8frame.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/aircraft_20_prompts_0_100_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/aircraft_20_prompts_0_100_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/caltech101_20_prompts_0_101_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/caltech101_20_prompts_0_101_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/dtd_20_prompts_0_47_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/dtd_20_prompts_0_47_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/eurosat_20_prompts.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/eurosat_20_prompts.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/flower102_20_prompts_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/flower102_20_prompts_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/food101_20_prompts_0_101_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/food101_20_prompts_0_101_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/hmdb_20_prompts_0_51_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/hmdb_20_prompts_0_51_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/imagenet_20_prompts_0_1000_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/imagenet_20_prompts_0_1000_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/k400_20_prompts_0_400_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/k400_20_prompts_0_400_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/modelnet10_20_prompts_0_10_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/modelnet10_20_prompts_0_10_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/pets_20_prompts_0_37_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/pets_20_prompts_0_37_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/raf_db_20_prompts.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/raf_db_20_prompts.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/ssv1_20_prompts_0_174_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/ssv1_20_prompts_0_174_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/stanford_car_20_prompts_0_196_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/stanford_car_20_prompts_0_196_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/sun397_20_prompts_0_397_api.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/sun397_20_prompts_0_397_api.json -------------------------------------------------------------------------------- /GPT4_generated_prompts/ucf_20_prompts.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/GPT4_generated_prompts/ucf_20_prompts.json -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/README.md -------------------------------------------------------------------------------- /annotations/aircraft_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/aircraft_gt.json -------------------------------------------------------------------------------- /annotations/caltech101_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/caltech101_gt.json -------------------------------------------------------------------------------- /annotations/dtd_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/dtd_gt.json -------------------------------------------------------------------------------- /annotations/eurosat_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/eurosat_gt.json -------------------------------------------------------------------------------- /annotations/flower102_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/flower102_gt.json -------------------------------------------------------------------------------- /annotations/food_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/food_gt.json -------------------------------------------------------------------------------- /annotations/hmdb_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/hmdb_gt.json -------------------------------------------------------------------------------- /annotations/imagenet_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/imagenet_gt.json -------------------------------------------------------------------------------- /annotations/k400_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/k400_gt.json -------------------------------------------------------------------------------- /annotations/modelnet10_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/modelnet10_gt.json -------------------------------------------------------------------------------- /annotations/pets_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/pets_gt.json -------------------------------------------------------------------------------- /annotations/rafdb_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/rafdb_gt.json -------------------------------------------------------------------------------- /annotations/stanford_cars_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/stanford_cars_gt.json -------------------------------------------------------------------------------- /annotations/sun397_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/sun397_gt.json -------------------------------------------------------------------------------- /annotations/ucf_gt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/annotations/ucf_gt.json -------------------------------------------------------------------------------- /calculate_acc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/calculate_acc.py -------------------------------------------------------------------------------- /config/aircraft.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/aircraft.yaml -------------------------------------------------------------------------------- /config/caltech101.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/caltech101.yaml -------------------------------------------------------------------------------- /config/dtd.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/dtd.yaml -------------------------------------------------------------------------------- /config/eurosat.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/eurosat.yaml -------------------------------------------------------------------------------- /config/flower102.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/flower102.yaml -------------------------------------------------------------------------------- /config/food101.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/food101.yaml -------------------------------------------------------------------------------- /config/hmdb.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/hmdb.yaml -------------------------------------------------------------------------------- /config/imagenet.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/imagenet.yaml -------------------------------------------------------------------------------- /config/k400.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/k400.yaml -------------------------------------------------------------------------------- /config/pets.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/pets.yaml -------------------------------------------------------------------------------- /config/raf_db.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/raf_db.yaml -------------------------------------------------------------------------------- /config/ssv1.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/ssv1.yaml -------------------------------------------------------------------------------- /config/stanford_car.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/stanford_car.yaml -------------------------------------------------------------------------------- /config/sun397.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/sun397.yaml -------------------------------------------------------------------------------- /config/ucf.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config/ucf.yaml -------------------------------------------------------------------------------- /config_path.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/config_path.py -------------------------------------------------------------------------------- /docs/datasets.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/docs/datasets.png -------------------------------------------------------------------------------- /docs/generated_sentences.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/docs/generated_sentences.png -------------------------------------------------------------------------------- /docs/gpt4v_prompt.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/docs/gpt4v_prompt.png -------------------------------------------------------------------------------- /docs/method.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/docs/method.png -------------------------------------------------------------------------------- /docs/results.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/docs/results.jpg -------------------------------------------------------------------------------- /generate_prompt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/whwu95/GPT4Vis/HEAD/generate_prompt.py --------------------------------------------------------------------------------