├── talk_slides_ACL2018.pdf ├── .gitmodules ├── README.md └── .gitignore /talk_slides_ACL2018.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pramodkaushik/acl18_results/HEAD/talk_slides_ACL2018.pdf -------------------------------------------------------------------------------- /.gitmodules: -------------------------------------------------------------------------------- 1 | [submodule "visual_qa_analysis"] 2 | path = visual_qa_analysis 3 | url = https://github.com/pramodkaushik/visual_qa_analysis.git 4 | [submodule "np_analysis"] 5 | path = np_analysis 6 | url = https://github.com/pramodkaushik/np_analysis.git 7 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Adversarial Attacks on Question Answering models 2 | 3 | Code to reproduce results in the paper 4 | 5 | Mudrakarta, Pramod Kaushik, Ankur Taly, Mukund Sundararajan, and Kedar Dhamdhere. "**Did the Model Understand the Question?.**" ACL 2018. 6 | 7 | ``` 8 | @article{mudrakarta2018did, 9 | title={Did the Model Understand the Question?}, 10 | author={Mudrakarta, Pramod Kaushik and Taly, Ankur and Sundararajan, Mukund and Dhamdhere, Kedar}, 11 | journal={arXiv preprint arXiv:1805.05492}, 12 | year={2018} 13 | } 14 | ``` 15 | 16 | # Setup 17 | 18 | Clone the repository using 19 | 20 | ``` 21 | git clone https://github.com/pramodkaushik/acl18_results.git --recursive 22 | ``` 23 | 24 | # Code for experiments 25 | 26 | Attacks on Neural Programmer are present in the folder `np_analysis`, and those on visual question answering in `visual_qa_analysis`. Code for computing attributions via Integrated Gradients and to reproduce experiments are in Jupyter notebooks in both these directories. 27 | 28 | # Contact 29 | 30 | Pramod Kaushik Mudrakarta 31 | 32 | [pramodkm@uchicago.edu](mailto:pramodkm@uchicago.edu) 33 | -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- 1 | # Byte-compiled / optimized / DLL files 2 | __pycache__/ 3 | *.py[cod] 4 | *$py.class 5 | 6 | # C extensions 7 | *.so 8 | 9 | # Distribution / packaging 10 | .Python 11 | env/ 12 | build/ 13 | develop-eggs/ 14 | dist/ 15 | downloads/ 16 | eggs/ 17 | .eggs/ 18 | lib/ 19 | lib64/ 20 | parts/ 21 | sdist/ 22 | var/ 23 | wheels/ 24 | *.egg-info/ 25 | .installed.cfg 26 | *.egg 27 | 28 | # PyInstaller 29 | # Usually these files are written by a python script from a template 30 | # before PyInstaller builds the exe, so as to inject date/other infos into it. 31 | *.manifest 32 | *.spec 33 | 34 | # Installer logs 35 | pip-log.txt 36 | pip-delete-this-directory.txt 37 | 38 | # Unit test / coverage reports 39 | htmlcov/ 40 | .tox/ 41 | .coverage 42 | .coverage.* 43 | .cache 44 | nosetests.xml 45 | coverage.xml 46 | *.cover 47 | .hypothesis/ 48 | 49 | # Translations 50 | *.mo 51 | *.pot 52 | 53 | # Django stuff: 54 | *.log 55 | local_settings.py 56 | 57 | # Flask stuff: 58 | instance/ 59 | .webassets-cache 60 | 61 | # Scrapy stuff: 62 | .scrapy 63 | 64 | # Sphinx documentation 65 | docs/_build/ 66 | 67 | # PyBuilder 68 | target/ 69 | 70 | # Jupyter Notebook 71 | .ipynb_checkpoints 72 | 73 | # pyenv 74 | .python-version 75 | 76 | # celery beat schedule file 77 | celerybeat-schedule 78 | 79 | # SageMath parsed files 80 | *.sage.py 81 | 82 | # dotenv 83 | .env 84 | 85 | # virtualenv 86 | .venv 87 | venv/ 88 | ENV/ 89 | 90 | # Spyder project settings 91 | .spyderproject 92 | .spyproject 93 | 94 | # Rope project settings 95 | .ropeproject 96 | 97 | # mkdocs documentation 98 | /site 99 | 100 | # mypy 101 | .mypy_cache/ 102 | --------------------------------------------------------------------------------