├── .DS_Store ├── .gitattributes ├── .gitignore ├── CONTRIBUTING.md ├── HP_scores ├── boolq_hp_score.pdf ├── csqa_hp_score.pdf ├── gsm8k_hp_scores.pdf ├── human_eval_hp_scores.pdf ├── iwslt2017_hp_score.pdf ├── mmlu_hp_scores.pdf └── samsum_hp_score.pdf ├── LICENSE ├── README.md ├── examples └── manual_hpf.ipynb ├── hierarchical_prompt ├── .DS_Store ├── dataloader │ ├── __init__.py │ └── data.py ├── main.py ├── metrics │ ├── __init__.py │ ├── bleu │ │ ├── bleu.py │ │ ├── bleu_.py │ │ └── tokenizer_13a.py │ ├── code_eval │ │ ├── __init__.py │ │ ├── execute.py │ │ └── human_eval.py │ ├── eval.py │ └── rouge │ │ ├── __init__.py │ │ └── rouge.py ├── models │ ├── __init__.py │ └── model.py ├── prompts │ ├── __init__.py │ └── prompts.py ├── requirements.txt ├── results.txt ├── results_adaptive.txt ├── run.sh └── utils │ ├── __init__.py │ └── postprocess.py ├── imgs ├── hpt.jpg ├── hpt.png └── hpt_logo.png ├── prompt_complexity ├── .DS_Store ├── data │ ├── boolq.json │ ├── csqa.json │ ├── gsm8k.json │ ├── humaneval.json │ ├── iwslt.json │ ├── mmlu.json │ └── samsum.json ├── prompt_complexity.py ├── prompts │ ├── __init__.py │ └── prompts.py └── scores.json └── templates ├── 3cot.md ├── gkp.md ├── leasttomost.md ├── role_prompting.md └── zcot.md /.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/.DS_Store -------------------------------------------------------------------------------- /.gitattributes: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/.gitattributes -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/.gitignore -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- 1 | contributing 2 | -------------------------------------------------------------------------------- /HP_scores/boolq_hp_score.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/HP_scores/boolq_hp_score.pdf -------------------------------------------------------------------------------- /HP_scores/csqa_hp_score.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/HP_scores/csqa_hp_score.pdf -------------------------------------------------------------------------------- /HP_scores/gsm8k_hp_scores.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/HP_scores/gsm8k_hp_scores.pdf -------------------------------------------------------------------------------- /HP_scores/human_eval_hp_scores.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/HP_scores/human_eval_hp_scores.pdf -------------------------------------------------------------------------------- /HP_scores/iwslt2017_hp_score.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/HP_scores/iwslt2017_hp_score.pdf -------------------------------------------------------------------------------- /HP_scores/mmlu_hp_scores.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/HP_scores/mmlu_hp_scores.pdf -------------------------------------------------------------------------------- /HP_scores/samsum_hp_score.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/HP_scores/samsum_hp_score.pdf -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/README.md -------------------------------------------------------------------------------- /examples/manual_hpf.ipynb: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /hierarchical_prompt/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/.DS_Store -------------------------------------------------------------------------------- /hierarchical_prompt/dataloader/__init__.py: -------------------------------------------------------------------------------- 1 | from .data import DatasetLoader -------------------------------------------------------------------------------- /hierarchical_prompt/dataloader/data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/dataloader/data.py -------------------------------------------------------------------------------- /hierarchical_prompt/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/main.py -------------------------------------------------------------------------------- /hierarchical_prompt/metrics/__init__.py: -------------------------------------------------------------------------------- 1 | from .eval import Eval -------------------------------------------------------------------------------- /hierarchical_prompt/metrics/bleu/bleu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/metrics/bleu/bleu.py -------------------------------------------------------------------------------- /hierarchical_prompt/metrics/bleu/bleu_.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/metrics/bleu/bleu_.py -------------------------------------------------------------------------------- /hierarchical_prompt/metrics/bleu/tokenizer_13a.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/metrics/bleu/tokenizer_13a.py -------------------------------------------------------------------------------- /hierarchical_prompt/metrics/code_eval/__init__.py: -------------------------------------------------------------------------------- 1 | from .human_eval import CodeEval 2 | -------------------------------------------------------------------------------- /hierarchical_prompt/metrics/code_eval/execute.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/metrics/code_eval/execute.py -------------------------------------------------------------------------------- /hierarchical_prompt/metrics/code_eval/human_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/metrics/code_eval/human_eval.py -------------------------------------------------------------------------------- /hierarchical_prompt/metrics/eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/metrics/eval.py -------------------------------------------------------------------------------- /hierarchical_prompt/metrics/rouge/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/metrics/rouge/__init__.py -------------------------------------------------------------------------------- /hierarchical_prompt/metrics/rouge/rouge.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/metrics/rouge/rouge.py -------------------------------------------------------------------------------- /hierarchical_prompt/models/__init__.py: -------------------------------------------------------------------------------- 1 | from .model import * -------------------------------------------------------------------------------- /hierarchical_prompt/models/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/models/model.py -------------------------------------------------------------------------------- /hierarchical_prompt/prompts/__init__.py: -------------------------------------------------------------------------------- 1 | from .prompts import * -------------------------------------------------------------------------------- /hierarchical_prompt/prompts/prompts.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/prompts/prompts.py -------------------------------------------------------------------------------- /hierarchical_prompt/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/requirements.txt -------------------------------------------------------------------------------- /hierarchical_prompt/results.txt: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /hierarchical_prompt/results_adaptive.txt: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /hierarchical_prompt/run.sh: -------------------------------------------------------------------------------- 1 | PYTHOIOENCODING=UTF-8 2 | python main.py "$@" 3 | -------------------------------------------------------------------------------- /hierarchical_prompt/utils/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/utils/__init__.py -------------------------------------------------------------------------------- /hierarchical_prompt/utils/postprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/hierarchical_prompt/utils/postprocess.py -------------------------------------------------------------------------------- /imgs/hpt.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/imgs/hpt.jpg -------------------------------------------------------------------------------- /imgs/hpt.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/imgs/hpt.png -------------------------------------------------------------------------------- /imgs/hpt_logo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/imgs/hpt_logo.png -------------------------------------------------------------------------------- /prompt_complexity/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/.DS_Store -------------------------------------------------------------------------------- /prompt_complexity/data/boolq.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/data/boolq.json -------------------------------------------------------------------------------- /prompt_complexity/data/csqa.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/data/csqa.json -------------------------------------------------------------------------------- /prompt_complexity/data/gsm8k.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/data/gsm8k.json -------------------------------------------------------------------------------- /prompt_complexity/data/humaneval.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/data/humaneval.json -------------------------------------------------------------------------------- /prompt_complexity/data/iwslt.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/data/iwslt.json -------------------------------------------------------------------------------- /prompt_complexity/data/mmlu.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/data/mmlu.json -------------------------------------------------------------------------------- /prompt_complexity/data/samsum.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/data/samsum.json -------------------------------------------------------------------------------- /prompt_complexity/prompt_complexity.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/prompt_complexity.py -------------------------------------------------------------------------------- /prompt_complexity/prompts/__init__.py: -------------------------------------------------------------------------------- 1 | from .prompts import * -------------------------------------------------------------------------------- /prompt_complexity/prompts/prompts.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/prompts/prompts.py -------------------------------------------------------------------------------- /prompt_complexity/scores.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/devichand579/HPT/HEAD/prompt_complexity/scores.json -------------------------------------------------------------------------------- /templates/3cot.md: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /templates/gkp.md: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /templates/leasttomost.md: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /templates/role_prompting.md: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /templates/zcot.md: -------------------------------------------------------------------------------- 1 | --------------------------------------------------------------------------------