├── README.md ├── data ├── README.md ├── crows_pairs_anonymized.csv └── prompts.csv ├── metric.py ├── mturk ├── _layouts │ ├── stereoset-validation.html │ └── validation.html ├── faq │ ├── faq.md │ ├── stereoset-validation.md │ └── validation.md └── hit_layouts │ ├── instructions.html │ ├── validationLayout.html │ └── validationLayoutStereo.html └── requirements.txt /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/README.md -------------------------------------------------------------------------------- /data/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/data/README.md -------------------------------------------------------------------------------- /data/crows_pairs_anonymized.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/data/crows_pairs_anonymized.csv -------------------------------------------------------------------------------- /data/prompts.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/data/prompts.csv -------------------------------------------------------------------------------- /metric.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/metric.py -------------------------------------------------------------------------------- /mturk/_layouts/stereoset-validation.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/mturk/_layouts/stereoset-validation.html -------------------------------------------------------------------------------- /mturk/_layouts/validation.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/mturk/_layouts/validation.html -------------------------------------------------------------------------------- /mturk/faq/faq.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/mturk/faq/faq.md -------------------------------------------------------------------------------- /mturk/faq/stereoset-validation.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/mturk/faq/stereoset-validation.md -------------------------------------------------------------------------------- /mturk/faq/validation.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/mturk/faq/validation.md -------------------------------------------------------------------------------- /mturk/hit_layouts/instructions.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/mturk/hit_layouts/instructions.html -------------------------------------------------------------------------------- /mturk/hit_layouts/validationLayout.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/mturk/hit_layouts/validationLayout.html -------------------------------------------------------------------------------- /mturk/hit_layouts/validationLayoutStereo.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/crows-pairs/HEAD/mturk/hit_layouts/validationLayoutStereo.html -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | pandas 2 | torch==1.4.0 3 | transformers==2.8.0 4 | numpy 5 | --------------------------------------------------------------------------------