├── README.md ├── data_generation ├── README.md ├── filter_table.py ├── filter_table_cot.py ├── filter_table_cot_random.py ├── filter_table_random.py ├── generate_fixed_instruction.py ├── generate_open_instruction.py ├── generate_table.py ├── generate_table_cot.py ├── generate_text.py ├── paraphrase_instruction.py └── requirements.txt ├── dataset ├── test_data.json ├── training_data.json └── training_data_cot.json ├── evaluation ├── rougel_for_content.py └── sim_for_header.py ├── human_evaluation ├── annotator1.json ├── annotator2.json └── annotator3.json ├── model_output ├── ODIE-7b-cot-filter.json ├── ODIE-7b-cot-random.json ├── ODIE-7b-filter.json ├── ODIE-7b-random.json ├── alpaca.json ├── gpt4.json ├── tulu.json └── turbo.json └── training ├── README.md ├── data ├── test.json ├── training_data.jsonl └── training_data_cot.jsonl ├── finetune.py ├── inference.py ├── requirements.txt ├── templates ├── alpaca.json ├── alpaca_legacy.json ├── alpaca_short.json └── vigogne.json ├── train.sh └── utils ├── README.md ├── __init__.py ├── callbacks.py └── prompter.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/README.md -------------------------------------------------------------------------------- /data_generation/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/README.md -------------------------------------------------------------------------------- /data_generation/filter_table.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/filter_table.py -------------------------------------------------------------------------------- /data_generation/filter_table_cot.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/filter_table_cot.py -------------------------------------------------------------------------------- /data_generation/filter_table_cot_random.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/filter_table_cot_random.py -------------------------------------------------------------------------------- /data_generation/filter_table_random.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/filter_table_random.py -------------------------------------------------------------------------------- /data_generation/generate_fixed_instruction.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/generate_fixed_instruction.py -------------------------------------------------------------------------------- /data_generation/generate_open_instruction.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/generate_open_instruction.py -------------------------------------------------------------------------------- /data_generation/generate_table.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/generate_table.py -------------------------------------------------------------------------------- /data_generation/generate_table_cot.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/generate_table_cot.py -------------------------------------------------------------------------------- /data_generation/generate_text.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/generate_text.py -------------------------------------------------------------------------------- /data_generation/paraphrase_instruction.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/paraphrase_instruction.py -------------------------------------------------------------------------------- /data_generation/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/data_generation/requirements.txt -------------------------------------------------------------------------------- /dataset/test_data.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/dataset/test_data.json -------------------------------------------------------------------------------- /dataset/training_data.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/dataset/training_data.json -------------------------------------------------------------------------------- /dataset/training_data_cot.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/dataset/training_data_cot.json -------------------------------------------------------------------------------- /evaluation/rougel_for_content.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/evaluation/rougel_for_content.py -------------------------------------------------------------------------------- /evaluation/sim_for_header.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/evaluation/sim_for_header.py -------------------------------------------------------------------------------- /human_evaluation/annotator1.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/human_evaluation/annotator1.json -------------------------------------------------------------------------------- /human_evaluation/annotator2.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/human_evaluation/annotator2.json -------------------------------------------------------------------------------- /human_evaluation/annotator3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/human_evaluation/annotator3.json -------------------------------------------------------------------------------- /model_output/ODIE-7b-cot-filter.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/model_output/ODIE-7b-cot-filter.json -------------------------------------------------------------------------------- /model_output/ODIE-7b-cot-random.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/model_output/ODIE-7b-cot-random.json -------------------------------------------------------------------------------- /model_output/ODIE-7b-filter.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/model_output/ODIE-7b-filter.json -------------------------------------------------------------------------------- /model_output/ODIE-7b-random.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/model_output/ODIE-7b-random.json -------------------------------------------------------------------------------- /model_output/alpaca.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/model_output/alpaca.json -------------------------------------------------------------------------------- /model_output/gpt4.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/model_output/gpt4.json -------------------------------------------------------------------------------- /model_output/tulu.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/model_output/tulu.json -------------------------------------------------------------------------------- /model_output/turbo.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/model_output/turbo.json -------------------------------------------------------------------------------- /training/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/README.md -------------------------------------------------------------------------------- /training/data/test.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/data/test.json -------------------------------------------------------------------------------- /training/data/training_data.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/data/training_data.jsonl -------------------------------------------------------------------------------- /training/data/training_data_cot.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/data/training_data_cot.jsonl -------------------------------------------------------------------------------- /training/finetune.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/finetune.py -------------------------------------------------------------------------------- /training/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/inference.py -------------------------------------------------------------------------------- /training/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/requirements.txt -------------------------------------------------------------------------------- /training/templates/alpaca.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/templates/alpaca.json -------------------------------------------------------------------------------- /training/templates/alpaca_legacy.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/templates/alpaca_legacy.json -------------------------------------------------------------------------------- /training/templates/alpaca_short.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/templates/alpaca_short.json -------------------------------------------------------------------------------- /training/templates/vigogne.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/templates/vigogne.json -------------------------------------------------------------------------------- /training/train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/train.sh -------------------------------------------------------------------------------- /training/utils/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/utils/README.md -------------------------------------------------------------------------------- /training/utils/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /training/utils/callbacks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/utils/callbacks.py -------------------------------------------------------------------------------- /training/utils/prompter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yzjiao/On-Demand-IE/HEAD/training/utils/prompter.py --------------------------------------------------------------------------------