├── .gitignore ├── collect.py ├── data ├── hq_sample.jsonl └── nq_sample.jsonl ├── examples ├── answer.jsonl ├── confidence.jsonl ├── post_answer.jsonl ├── post_confidence.jsonl ├── test.jsonl ├── test_dense_static.jsonl ├── test_gold_static.jsonl └── test_new.jsonl ├── readme.md ├── run_llm.py ├── scripts ├── process.sh └── run.sh └── utils ├── __init__.py ├── __pycache__ ├── __init__.cpython-38.pyc ├── compu.cpython-38.pyc ├── compute.cpython-38.pyc ├── llm.cpython-38.pyc ├── plot.cpython-38.pyc ├── preprocess.cpython-38.pyc ├── prompt.cpython-38.pyc └── utils.cpython-38.pyc ├── compute.py ├── llm.py ├── preprocess.py ├── prompt.py └── utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/.gitignore -------------------------------------------------------------------------------- /collect.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/collect.py -------------------------------------------------------------------------------- /data/hq_sample.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/data/hq_sample.jsonl -------------------------------------------------------------------------------- /data/nq_sample.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/data/nq_sample.jsonl -------------------------------------------------------------------------------- /examples/answer.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/examples/answer.jsonl -------------------------------------------------------------------------------- /examples/confidence.jsonl: -------------------------------------------------------------------------------- 1 | 102 2 | 344 3 | 463 4 | 470 5 | 566 6 | 811 7 | -------------------------------------------------------------------------------- /examples/post_answer.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/examples/post_answer.jsonl -------------------------------------------------------------------------------- /examples/post_confidence.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/examples/post_confidence.jsonl -------------------------------------------------------------------------------- /examples/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/examples/test.jsonl -------------------------------------------------------------------------------- /examples/test_dense_static.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/examples/test_dense_static.jsonl -------------------------------------------------------------------------------- /examples/test_gold_static.jsonl: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /examples/test_new.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/examples/test_new.jsonl -------------------------------------------------------------------------------- /readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/readme.md -------------------------------------------------------------------------------- /run_llm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/run_llm.py -------------------------------------------------------------------------------- /scripts/process.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/scripts/process.sh -------------------------------------------------------------------------------- /scripts/run.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/scripts/run.sh -------------------------------------------------------------------------------- /utils/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /utils/__pycache__/__init__.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/__pycache__/__init__.cpython-38.pyc -------------------------------------------------------------------------------- /utils/__pycache__/compu.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/__pycache__/compu.cpython-38.pyc -------------------------------------------------------------------------------- /utils/__pycache__/compute.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/__pycache__/compute.cpython-38.pyc -------------------------------------------------------------------------------- /utils/__pycache__/llm.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/__pycache__/llm.cpython-38.pyc -------------------------------------------------------------------------------- /utils/__pycache__/plot.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/__pycache__/plot.cpython-38.pyc -------------------------------------------------------------------------------- /utils/__pycache__/preprocess.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/__pycache__/preprocess.cpython-38.pyc -------------------------------------------------------------------------------- /utils/__pycache__/prompt.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/__pycache__/prompt.cpython-38.pyc -------------------------------------------------------------------------------- /utils/__pycache__/utils.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/__pycache__/utils.cpython-38.pyc -------------------------------------------------------------------------------- /utils/compute.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/compute.py -------------------------------------------------------------------------------- /utils/llm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/llm.py -------------------------------------------------------------------------------- /utils/preprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/preprocess.py -------------------------------------------------------------------------------- /utils/prompt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/prompt.py -------------------------------------------------------------------------------- /utils/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Trustworthy-Information-Access/When-to-Retrieve/HEAD/utils/utils.py --------------------------------------------------------------------------------