├── README.md ├── extract_answers.py ├── figure └── framework.png ├── query_multistep.py ├── query_self_probing.py ├── query_top_k.py ├── query_vanilla_or_cot.py ├── scripts ├── query_self_probing_self_random.sh ├── query_top_k_self_random.sh ├── query_top_k_verbalized.sh ├── query_vanilla_misleading.sh └── query_vanilla_verbalized.sh ├── utils ├── __init__.py ├── api_llama.py ├── api_local.py ├── compute_metrics.py ├── dataset_loader.py ├── extract_result_lib.py ├── extract_result_lib2.py ├── inference.py └── llm_query_helper.py ├── vis_aggregated_conf.py └── vis_aggregated_conf_top_k.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/README.md -------------------------------------------------------------------------------- /extract_answers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/extract_answers.py -------------------------------------------------------------------------------- /figure/framework.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/figure/framework.png -------------------------------------------------------------------------------- /query_multistep.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/query_multistep.py -------------------------------------------------------------------------------- /query_self_probing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/query_self_probing.py -------------------------------------------------------------------------------- /query_top_k.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/query_top_k.py -------------------------------------------------------------------------------- /query_vanilla_or_cot.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/query_vanilla_or_cot.py -------------------------------------------------------------------------------- /scripts/query_self_probing_self_random.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/scripts/query_self_probing_self_random.sh -------------------------------------------------------------------------------- /scripts/query_top_k_self_random.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/scripts/query_top_k_self_random.sh -------------------------------------------------------------------------------- /scripts/query_top_k_verbalized.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/scripts/query_top_k_verbalized.sh -------------------------------------------------------------------------------- /scripts/query_vanilla_misleading.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/scripts/query_vanilla_misleading.sh -------------------------------------------------------------------------------- /scripts/query_vanilla_verbalized.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/scripts/query_vanilla_verbalized.sh -------------------------------------------------------------------------------- /utils/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /utils/api_llama.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/utils/api_llama.py -------------------------------------------------------------------------------- /utils/api_local.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/utils/api_local.py -------------------------------------------------------------------------------- /utils/compute_metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/utils/compute_metrics.py -------------------------------------------------------------------------------- /utils/dataset_loader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/utils/dataset_loader.py -------------------------------------------------------------------------------- /utils/extract_result_lib.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/utils/extract_result_lib.py -------------------------------------------------------------------------------- /utils/extract_result_lib2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/utils/extract_result_lib2.py -------------------------------------------------------------------------------- /utils/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/utils/inference.py -------------------------------------------------------------------------------- /utils/llm_query_helper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/utils/llm_query_helper.py -------------------------------------------------------------------------------- /vis_aggregated_conf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/vis_aggregated_conf.py -------------------------------------------------------------------------------- /vis_aggregated_conf_top_k.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MiaoXiong2320/llm-uncertainty/HEAD/vis_aggregated_conf_top_k.py --------------------------------------------------------------------------------