├── LICENSE ├── README.md ├── mixout.py ├── model_utils.py ├── options.py ├── prior_wd_optim.py ├── repo_illustration.png ├── requirements.txt ├── run_glue.py └── sample_commands ├── debiased_adam_baseline.sh ├── debiased_adam_longer.sh ├── llrd.sh ├── mixout.sh ├── pretrained_wd.sh └── reinit.sh /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/README.md -------------------------------------------------------------------------------- /mixout.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/mixout.py -------------------------------------------------------------------------------- /model_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/model_utils.py -------------------------------------------------------------------------------- /options.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/options.py -------------------------------------------------------------------------------- /prior_wd_optim.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/prior_wd_optim.py -------------------------------------------------------------------------------- /repo_illustration.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/repo_illustration.png -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | torch==1.4.0 2 | transformers==2.5.0 3 | tqdm 4 | numpy 5 | pandas -------------------------------------------------------------------------------- /run_glue.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/run_glue.py -------------------------------------------------------------------------------- /sample_commands/debiased_adam_baseline.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/sample_commands/debiased_adam_baseline.sh -------------------------------------------------------------------------------- /sample_commands/debiased_adam_longer.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/sample_commands/debiased_adam_longer.sh -------------------------------------------------------------------------------- /sample_commands/llrd.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/sample_commands/llrd.sh -------------------------------------------------------------------------------- /sample_commands/mixout.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/sample_commands/mixout.sh -------------------------------------------------------------------------------- /sample_commands/pretrained_wd.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/sample_commands/pretrained_wd.sh -------------------------------------------------------------------------------- /sample_commands/reinit.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/asappresearch/revisit-bert-finetuning/HEAD/sample_commands/reinit.sh --------------------------------------------------------------------------------