├── LICENSE ├── README.md ├── attention.py ├── base_model.py ├── base_model_ab.py ├── base_model_ban.py ├── base_model_block.py ├── base_model_sf.py ├── base_model_sfce.py ├── base_model_v_only.py ├── classifier.py ├── dataset.py ├── fc.py ├── language_model.py ├── main.py ├── main.sh ├── main_rubi.sh ├── requirements.yml ├── rubi_base_model.py ├── rubi_main.py ├── rubi_train.py ├── sensitivity.py ├── sensitivity.sh ├── tools ├── compute_softscore.py ├── create_dictionary.py ├── create_dictionary_v1.py ├── download.sh └── process.sh ├── train_GGE.py ├── train_ab.py ├── util ├── cpv1_notype_mask.json ├── cpv1_type_mask.json ├── cpv2_notype_mask.json ├── cpv2_type_mask.json ├── qid2type_cpv1.json ├── qid2type_cpv2.json ├── qid2type_v2.json ├── v2_notype_mask.json └── v2_type_mask.json ├── utils.py ├── visualization.ipynb ├── visualization_updn.ipynb └── vqa_debias_loss_functions.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/README.md -------------------------------------------------------------------------------- /attention.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/attention.py -------------------------------------------------------------------------------- /base_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/base_model.py -------------------------------------------------------------------------------- /base_model_ab.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/base_model_ab.py -------------------------------------------------------------------------------- /base_model_ban.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/base_model_ban.py -------------------------------------------------------------------------------- /base_model_block.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/base_model_block.py -------------------------------------------------------------------------------- /base_model_sf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/base_model_sf.py -------------------------------------------------------------------------------- /base_model_sfce.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/base_model_sfce.py -------------------------------------------------------------------------------- /base_model_v_only.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/base_model_v_only.py -------------------------------------------------------------------------------- /classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/classifier.py -------------------------------------------------------------------------------- /dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/dataset.py -------------------------------------------------------------------------------- /fc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/fc.py -------------------------------------------------------------------------------- /language_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/language_model.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/main.py -------------------------------------------------------------------------------- /main.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/main.sh -------------------------------------------------------------------------------- /main_rubi.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/main_rubi.sh -------------------------------------------------------------------------------- /requirements.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/requirements.yml -------------------------------------------------------------------------------- /rubi_base_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/rubi_base_model.py -------------------------------------------------------------------------------- /rubi_main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/rubi_main.py -------------------------------------------------------------------------------- /rubi_train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/rubi_train.py -------------------------------------------------------------------------------- /sensitivity.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/sensitivity.py -------------------------------------------------------------------------------- /sensitivity.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/sensitivity.sh -------------------------------------------------------------------------------- /tools/compute_softscore.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/tools/compute_softscore.py -------------------------------------------------------------------------------- /tools/create_dictionary.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/tools/create_dictionary.py -------------------------------------------------------------------------------- /tools/create_dictionary_v1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/tools/create_dictionary_v1.py -------------------------------------------------------------------------------- /tools/download.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/tools/download.sh -------------------------------------------------------------------------------- /tools/process.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/tools/process.sh -------------------------------------------------------------------------------- /train_GGE.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/train_GGE.py -------------------------------------------------------------------------------- /train_ab.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/train_ab.py -------------------------------------------------------------------------------- /util/cpv1_notype_mask.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/util/cpv1_notype_mask.json -------------------------------------------------------------------------------- /util/cpv1_type_mask.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/util/cpv1_type_mask.json -------------------------------------------------------------------------------- /util/cpv2_notype_mask.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/util/cpv2_notype_mask.json -------------------------------------------------------------------------------- /util/cpv2_type_mask.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/util/cpv2_type_mask.json -------------------------------------------------------------------------------- /util/qid2type_cpv1.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/util/qid2type_cpv1.json -------------------------------------------------------------------------------- /util/qid2type_cpv2.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/util/qid2type_cpv2.json -------------------------------------------------------------------------------- /util/qid2type_v2.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/util/qid2type_v2.json -------------------------------------------------------------------------------- /util/v2_notype_mask.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/util/v2_notype_mask.json -------------------------------------------------------------------------------- /util/v2_type_mask.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/util/v2_type_mask.json -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/utils.py -------------------------------------------------------------------------------- /visualization.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/visualization.ipynb -------------------------------------------------------------------------------- /visualization_updn.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/visualization_updn.ipynb -------------------------------------------------------------------------------- /vqa_debias_loss_functions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/GeraldHan/GGE/HEAD/vqa_debias_loss_functions.py --------------------------------------------------------------------------------