├── LICENSE ├── README.md ├── adversarial_refine.py ├── assets ├── example.pdf ├── existing_eval.png ├── re_eval.png ├── sugar_crepe.png ├── sugarcrepe_eval.png └── sugarcrepe_vs_existing.png ├── data ├── add_att.json ├── add_obj.json ├── replace_att.json ├── replace_obj.json ├── replace_rel.json ├── swap_att.json └── swap_obj.json ├── data_card.pdf ├── data_unrefined ├── add_att.json ├── add_obj.json ├── replace_att.json ├── replace_obj.json ├── replace_rel.json ├── swap_att.json └── swap_obj.json ├── gpt-4v-results ├── negative-first │ ├── gpt4v-add_att.json │ ├── gpt4v-add_obj.json │ ├── gpt4v-replace_att.json │ ├── gpt4v-replace_obj.json │ ├── gpt4v-replace_rel.json │ ├── gpt4v-swap_att.json │ └── gpt4v-swap_obj.json ├── positive-first │ ├── gpt4v-add_att.json │ ├── gpt4v-add_obj.json │ ├── gpt4v-replace_att.json │ ├── gpt4v-replace_obj.json │ ├── gpt4v-replace_rel.json │ ├── gpt4v-swap_att.json │ └── gpt4v-swap_obj.json └── readme.md ├── main_eval.py └── text_model_eval.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/README.md -------------------------------------------------------------------------------- /adversarial_refine.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/adversarial_refine.py -------------------------------------------------------------------------------- /assets/example.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/assets/example.pdf -------------------------------------------------------------------------------- /assets/existing_eval.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/assets/existing_eval.png -------------------------------------------------------------------------------- /assets/re_eval.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/assets/re_eval.png -------------------------------------------------------------------------------- /assets/sugar_crepe.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/assets/sugar_crepe.png -------------------------------------------------------------------------------- /assets/sugarcrepe_eval.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/assets/sugarcrepe_eval.png -------------------------------------------------------------------------------- /assets/sugarcrepe_vs_existing.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/assets/sugarcrepe_vs_existing.png -------------------------------------------------------------------------------- /data/add_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data/add_att.json -------------------------------------------------------------------------------- /data/add_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data/add_obj.json -------------------------------------------------------------------------------- /data/replace_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data/replace_att.json -------------------------------------------------------------------------------- /data/replace_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data/replace_obj.json -------------------------------------------------------------------------------- /data/replace_rel.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data/replace_rel.json -------------------------------------------------------------------------------- /data/swap_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data/swap_att.json -------------------------------------------------------------------------------- /data/swap_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data/swap_obj.json -------------------------------------------------------------------------------- /data_card.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data_card.pdf -------------------------------------------------------------------------------- /data_unrefined/add_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data_unrefined/add_att.json -------------------------------------------------------------------------------- /data_unrefined/add_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data_unrefined/add_obj.json -------------------------------------------------------------------------------- /data_unrefined/replace_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data_unrefined/replace_att.json -------------------------------------------------------------------------------- /data_unrefined/replace_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data_unrefined/replace_obj.json -------------------------------------------------------------------------------- /data_unrefined/replace_rel.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data_unrefined/replace_rel.json -------------------------------------------------------------------------------- /data_unrefined/swap_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data_unrefined/swap_att.json -------------------------------------------------------------------------------- /data_unrefined/swap_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/data_unrefined/swap_obj.json -------------------------------------------------------------------------------- /gpt-4v-results/negative-first/gpt4v-add_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/negative-first/gpt4v-add_att.json -------------------------------------------------------------------------------- /gpt-4v-results/negative-first/gpt4v-add_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/negative-first/gpt4v-add_obj.json -------------------------------------------------------------------------------- /gpt-4v-results/negative-first/gpt4v-replace_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/negative-first/gpt4v-replace_att.json -------------------------------------------------------------------------------- /gpt-4v-results/negative-first/gpt4v-replace_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/negative-first/gpt4v-replace_obj.json -------------------------------------------------------------------------------- /gpt-4v-results/negative-first/gpt4v-replace_rel.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/negative-first/gpt4v-replace_rel.json -------------------------------------------------------------------------------- /gpt-4v-results/negative-first/gpt4v-swap_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/negative-first/gpt4v-swap_att.json -------------------------------------------------------------------------------- /gpt-4v-results/negative-first/gpt4v-swap_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/negative-first/gpt4v-swap_obj.json -------------------------------------------------------------------------------- /gpt-4v-results/positive-first/gpt4v-add_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/positive-first/gpt4v-add_att.json -------------------------------------------------------------------------------- /gpt-4v-results/positive-first/gpt4v-add_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/positive-first/gpt4v-add_obj.json -------------------------------------------------------------------------------- /gpt-4v-results/positive-first/gpt4v-replace_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/positive-first/gpt4v-replace_att.json -------------------------------------------------------------------------------- /gpt-4v-results/positive-first/gpt4v-replace_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/positive-first/gpt4v-replace_obj.json -------------------------------------------------------------------------------- /gpt-4v-results/positive-first/gpt4v-replace_rel.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/positive-first/gpt4v-replace_rel.json -------------------------------------------------------------------------------- /gpt-4v-results/positive-first/gpt4v-swap_att.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/positive-first/gpt4v-swap_att.json -------------------------------------------------------------------------------- /gpt-4v-results/positive-first/gpt4v-swap_obj.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/positive-first/gpt4v-swap_obj.json -------------------------------------------------------------------------------- /gpt-4v-results/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/gpt-4v-results/readme.md -------------------------------------------------------------------------------- /main_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/main_eval.py -------------------------------------------------------------------------------- /text_model_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RAIVNLab/sugar-crepe/HEAD/text_model_eval.py --------------------------------------------------------------------------------