├── Data ├── FHM_rationale.json ├── README.md ├── chatgpt_abductive_reasoning.py ├── harmc_rationale.json ├── harmp_rationale.json └── training and inference data │ ├── FHM │ ├── captions.pkl │ ├── test.jsonl │ └── train.jsonl │ ├── harmc │ ├── captions.pkl │ ├── test.jsonl │ └── train.jsonl │ └── harmp │ ├── captions.pkl │ ├── test.jsonl │ └── train.jsonl ├── LICENSE ├── README.md ├── requirements.txt ├── run.py └── src ├── __init__.py ├── config.py ├── datamodules ├── __init__.py ├── datamodule_base.py ├── meme_datamodule.py └── multitask_datamodule.py ├── datasets ├── __init__.py ├── base_dataset.py └── meme.py ├── gadgets ├── __init__.py └── my_metrics.py ├── modules ├── __init__.py ├── dist_utils.py ├── heads.py ├── mm_module.py ├── mm_utils.py ├── objectives.py └── t5_model.py ├── transforms ├── __init__.py ├── randaug.py ├── transform.py └── utils.py └── utils ├── __init__.py └── glossary.py /Data/FHM_rationale.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/FHM_rationale.json -------------------------------------------------------------------------------- /Data/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/README.md -------------------------------------------------------------------------------- /Data/chatgpt_abductive_reasoning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/chatgpt_abductive_reasoning.py -------------------------------------------------------------------------------- /Data/harmc_rationale.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/harmc_rationale.json -------------------------------------------------------------------------------- /Data/harmp_rationale.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/harmp_rationale.json -------------------------------------------------------------------------------- /Data/training and inference data/FHM/captions.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/training and inference data/FHM/captions.pkl -------------------------------------------------------------------------------- /Data/training and inference data/FHM/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/training and inference data/FHM/test.jsonl -------------------------------------------------------------------------------- /Data/training and inference data/FHM/train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/training and inference data/FHM/train.jsonl -------------------------------------------------------------------------------- /Data/training and inference data/harmc/captions.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/training and inference data/harmc/captions.pkl -------------------------------------------------------------------------------- /Data/training and inference data/harmc/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/training and inference data/harmc/test.jsonl -------------------------------------------------------------------------------- /Data/training and inference data/harmc/train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/training and inference data/harmc/train.jsonl -------------------------------------------------------------------------------- /Data/training and inference data/harmp/captions.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/training and inference data/harmp/captions.pkl -------------------------------------------------------------------------------- /Data/training and inference data/harmp/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/training and inference data/harmp/test.jsonl -------------------------------------------------------------------------------- /Data/training and inference data/harmp/train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/Data/training and inference data/harmp/train.jsonl -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/README.md -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/requirements.txt -------------------------------------------------------------------------------- /run.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/run.py -------------------------------------------------------------------------------- /src/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/config.py -------------------------------------------------------------------------------- /src/datamodules/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/datamodules/__init__.py -------------------------------------------------------------------------------- /src/datamodules/datamodule_base.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/datamodules/datamodule_base.py -------------------------------------------------------------------------------- /src/datamodules/meme_datamodule.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/datamodules/meme_datamodule.py -------------------------------------------------------------------------------- /src/datamodules/multitask_datamodule.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/datamodules/multitask_datamodule.py -------------------------------------------------------------------------------- /src/datasets/__init__.py: -------------------------------------------------------------------------------- 1 | from .meme import MemeDataset 2 | -------------------------------------------------------------------------------- /src/datasets/base_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/datasets/base_dataset.py -------------------------------------------------------------------------------- /src/datasets/meme.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/datasets/meme.py -------------------------------------------------------------------------------- /src/gadgets/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/gadgets/my_metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/gadgets/my_metrics.py -------------------------------------------------------------------------------- /src/modules/__init__.py: -------------------------------------------------------------------------------- 1 | from .mm_module import MMTransformerSS -------------------------------------------------------------------------------- /src/modules/dist_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/modules/dist_utils.py -------------------------------------------------------------------------------- /src/modules/heads.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/modules/heads.py -------------------------------------------------------------------------------- /src/modules/mm_module.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/modules/mm_module.py -------------------------------------------------------------------------------- /src/modules/mm_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/modules/mm_utils.py -------------------------------------------------------------------------------- /src/modules/objectives.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/modules/objectives.py -------------------------------------------------------------------------------- /src/modules/t5_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/modules/t5_model.py -------------------------------------------------------------------------------- /src/transforms/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/transforms/__init__.py -------------------------------------------------------------------------------- /src/transforms/randaug.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/transforms/randaug.py -------------------------------------------------------------------------------- /src/transforms/transform.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/transforms/transform.py -------------------------------------------------------------------------------- /src/transforms/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/transforms/utils.py -------------------------------------------------------------------------------- /src/utils/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/utils/glossary.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKBUNLP/Mr.Harm-EMNLP2023/HEAD/src/utils/glossary.py --------------------------------------------------------------------------------