├── .gitignore ├── LICENSE ├── README.md ├── apps.py ├── assets ├── task_schema.png └── zero_shot_results.png ├── configs ├── dataset_configs │ ├── supervised_configs │ │ ├── dev_configs.json │ │ ├── test_configs.json │ │ └── train_configs.json │ └── task_adaptation_configs │ │ ├── dev_configs.json │ │ ├── test_configs.json │ │ └── train_configs.json ├── deepspeed_configs │ ├── deepspeed_zero0_llama.json │ ├── deepspeed_zero0_t5.json │ ├── deepspeed_zero1_llama.json │ ├── deepspeed_zero1_t5.json │ ├── deepspeed_zero2_llama.json │ └── deepspeed_zero2_t5.json └── instruction_configs │ └── instruction.json ├── data └── zero-shot-test.jsonl ├── evaluate.py ├── model_predictions ├── flan-t5-xxl-task-adaptation-beam1.jsonl └── llama-7b-task-adaptation-beam1.jsonl ├── notebook.ipynb ├── scripts ├── eval_llama_task_adaptation.sh ├── eval_t5_task_adaptation.sh ├── eval_t5_task_adaptation_json_input.sh ├── train_llama_task_adaptation.sh ├── train_t5_base_task_adaptation.sh ├── train_t5_large_task_adaptation.sh ├── train_t5_xl_task_adaptation.sh └── train_t5_xxl_task_adaptation.sh └── src ├── gner_collator.py ├── gner_dataset.py ├── gner_evaluator.py ├── gner_trainer.py └── run.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/README.md -------------------------------------------------------------------------------- /apps.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/apps.py -------------------------------------------------------------------------------- /assets/task_schema.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/assets/task_schema.png -------------------------------------------------------------------------------- /assets/zero_shot_results.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/assets/zero_shot_results.png -------------------------------------------------------------------------------- /configs/dataset_configs/supervised_configs/dev_configs.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/dataset_configs/supervised_configs/dev_configs.json -------------------------------------------------------------------------------- /configs/dataset_configs/supervised_configs/test_configs.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/dataset_configs/supervised_configs/test_configs.json -------------------------------------------------------------------------------- /configs/dataset_configs/supervised_configs/train_configs.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/dataset_configs/supervised_configs/train_configs.json -------------------------------------------------------------------------------- /configs/dataset_configs/task_adaptation_configs/dev_configs.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/dataset_configs/task_adaptation_configs/dev_configs.json -------------------------------------------------------------------------------- /configs/dataset_configs/task_adaptation_configs/test_configs.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/dataset_configs/task_adaptation_configs/test_configs.json -------------------------------------------------------------------------------- /configs/dataset_configs/task_adaptation_configs/train_configs.json: -------------------------------------------------------------------------------- 1 | [] 2 | -------------------------------------------------------------------------------- /configs/deepspeed_configs/deepspeed_zero0_llama.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/deepspeed_configs/deepspeed_zero0_llama.json -------------------------------------------------------------------------------- /configs/deepspeed_configs/deepspeed_zero0_t5.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/deepspeed_configs/deepspeed_zero0_t5.json -------------------------------------------------------------------------------- /configs/deepspeed_configs/deepspeed_zero1_llama.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/deepspeed_configs/deepspeed_zero1_llama.json -------------------------------------------------------------------------------- /configs/deepspeed_configs/deepspeed_zero1_t5.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/deepspeed_configs/deepspeed_zero1_t5.json -------------------------------------------------------------------------------- /configs/deepspeed_configs/deepspeed_zero2_llama.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/deepspeed_configs/deepspeed_zero2_llama.json -------------------------------------------------------------------------------- /configs/deepspeed_configs/deepspeed_zero2_t5.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/deepspeed_configs/deepspeed_zero2_t5.json -------------------------------------------------------------------------------- /configs/instruction_configs/instruction.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/configs/instruction_configs/instruction.json -------------------------------------------------------------------------------- /data/zero-shot-test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/data/zero-shot-test.jsonl -------------------------------------------------------------------------------- /evaluate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/evaluate.py -------------------------------------------------------------------------------- /model_predictions/flan-t5-xxl-task-adaptation-beam1.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/model_predictions/flan-t5-xxl-task-adaptation-beam1.jsonl -------------------------------------------------------------------------------- /model_predictions/llama-7b-task-adaptation-beam1.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/model_predictions/llama-7b-task-adaptation-beam1.jsonl -------------------------------------------------------------------------------- /notebook.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/notebook.ipynb -------------------------------------------------------------------------------- /scripts/eval_llama_task_adaptation.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/scripts/eval_llama_task_adaptation.sh -------------------------------------------------------------------------------- /scripts/eval_t5_task_adaptation.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/scripts/eval_t5_task_adaptation.sh -------------------------------------------------------------------------------- /scripts/eval_t5_task_adaptation_json_input.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/scripts/eval_t5_task_adaptation_json_input.sh -------------------------------------------------------------------------------- /scripts/train_llama_task_adaptation.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/scripts/train_llama_task_adaptation.sh -------------------------------------------------------------------------------- /scripts/train_t5_base_task_adaptation.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/scripts/train_t5_base_task_adaptation.sh -------------------------------------------------------------------------------- /scripts/train_t5_large_task_adaptation.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/scripts/train_t5_large_task_adaptation.sh -------------------------------------------------------------------------------- /scripts/train_t5_xl_task_adaptation.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/scripts/train_t5_xl_task_adaptation.sh -------------------------------------------------------------------------------- /scripts/train_t5_xxl_task_adaptation.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/scripts/train_t5_xxl_task_adaptation.sh -------------------------------------------------------------------------------- /src/gner_collator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/src/gner_collator.py -------------------------------------------------------------------------------- /src/gner_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/src/gner_dataset.py -------------------------------------------------------------------------------- /src/gner_evaluator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/src/gner_evaluator.py -------------------------------------------------------------------------------- /src/gner_trainer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/src/gner_trainer.py -------------------------------------------------------------------------------- /src/run.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yyDing1/GNER/HEAD/src/run.py --------------------------------------------------------------------------------