├── BBQ └── utils.py ├── LICENSE ├── README.md ├── bbnli_inference_bias.py ├── bbq_inference_bias.py ├── bias_teaser.png ├── call_bbnli_inference_bias.py ├── data ├── bbnli │ ├── gender │ │ ├── man_is_to_breadwinner.json │ │ ├── man_is_to_programmer.json │ │ ├── man_is_to_rational.json │ │ ├── man_is_to_surgeon.json │ │ └── woman_is_to_homemaker.json │ ├── race │ │ ├── asian_men_to_feminine.json │ │ ├── black_is_to_criminal.json │ │ ├── black_is_to_impoverished.json │ │ ├── black_people_use_drugs.json │ │ └── white_is_to_clean.json │ ├── religion │ │ ├── catholic_woman_to_many_kids.json │ │ ├── jewish_woman_to_many_kids.json │ │ ├── mormon_man_to_oppressive.json │ │ ├── muslim_man_to_many_wives.json │ │ ├── muslim_man_to_oppressive.json │ │ └── muslim_women_to_invisible.json │ └── validation_secret.csv ├── bbq │ └── templates │ │ ├── new_templates - Gender_identity.csv │ │ ├── new_templates - Race_ethnicity.csv │ │ └── new_templates - Religion.csv └── novel_qa_templates.json ├── json2csv.py └── setup.sh /BBQ/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/BBQ/utils.py -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/README.md -------------------------------------------------------------------------------- /bbnli_inference_bias.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/bbnli_inference_bias.py -------------------------------------------------------------------------------- /bbq_inference_bias.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/bbq_inference_bias.py -------------------------------------------------------------------------------- /bias_teaser.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/bias_teaser.png -------------------------------------------------------------------------------- /call_bbnli_inference_bias.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/call_bbnli_inference_bias.py -------------------------------------------------------------------------------- /data/bbnli/gender/man_is_to_breadwinner.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/gender/man_is_to_breadwinner.json -------------------------------------------------------------------------------- /data/bbnli/gender/man_is_to_programmer.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/gender/man_is_to_programmer.json -------------------------------------------------------------------------------- /data/bbnli/gender/man_is_to_rational.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/gender/man_is_to_rational.json -------------------------------------------------------------------------------- /data/bbnli/gender/man_is_to_surgeon.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/gender/man_is_to_surgeon.json -------------------------------------------------------------------------------- /data/bbnli/gender/woman_is_to_homemaker.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/gender/woman_is_to_homemaker.json -------------------------------------------------------------------------------- /data/bbnli/race/asian_men_to_feminine.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/race/asian_men_to_feminine.json -------------------------------------------------------------------------------- /data/bbnli/race/black_is_to_criminal.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/race/black_is_to_criminal.json -------------------------------------------------------------------------------- /data/bbnli/race/black_is_to_impoverished.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/race/black_is_to_impoverished.json -------------------------------------------------------------------------------- /data/bbnli/race/black_people_use_drugs.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/race/black_people_use_drugs.json -------------------------------------------------------------------------------- /data/bbnli/race/white_is_to_clean.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/race/white_is_to_clean.json -------------------------------------------------------------------------------- /data/bbnli/religion/catholic_woman_to_many_kids.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/religion/catholic_woman_to_many_kids.json -------------------------------------------------------------------------------- /data/bbnli/religion/jewish_woman_to_many_kids.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/religion/jewish_woman_to_many_kids.json -------------------------------------------------------------------------------- /data/bbnli/religion/mormon_man_to_oppressive.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/religion/mormon_man_to_oppressive.json -------------------------------------------------------------------------------- /data/bbnli/religion/muslim_man_to_many_wives.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/religion/muslim_man_to_many_wives.json -------------------------------------------------------------------------------- /data/bbnli/religion/muslim_man_to_oppressive.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/religion/muslim_man_to_oppressive.json -------------------------------------------------------------------------------- /data/bbnli/religion/muslim_women_to_invisible.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/religion/muslim_women_to_invisible.json -------------------------------------------------------------------------------- /data/bbnli/validation_secret.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbnli/validation_secret.csv -------------------------------------------------------------------------------- /data/bbq/templates/new_templates - Gender_identity.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbq/templates/new_templates - Gender_identity.csv -------------------------------------------------------------------------------- /data/bbq/templates/new_templates - Race_ethnicity.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbq/templates/new_templates - Race_ethnicity.csv -------------------------------------------------------------------------------- /data/bbq/templates/new_templates - Religion.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/bbq/templates/new_templates - Religion.csv -------------------------------------------------------------------------------- /data/novel_qa_templates.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/data/novel_qa_templates.json -------------------------------------------------------------------------------- /json2csv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/json2csv.py -------------------------------------------------------------------------------- /setup.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feyzaakyurek/bbnli/HEAD/setup.sh --------------------------------------------------------------------------------