├── README.md ├── generation.py ├── init_environ.sh ├── openai_key.txt ├── parsing.py ├── requirements_csenv.txt ├── requirements_fsenv.txt ├── scoring ├── confidence_scoring │ ├── atomic_fact_to_q.py │ ├── atomic_sample_answers.py │ ├── compute_confidence_score_bio.sh │ ├── entity_sample.py │ ├── score_metrics.py │ ├── utils_atomic_q.py │ └── utils_atomic_sample.py └── factscoring │ ├── compute_factscore_bio.sh │ └── run_factscoring.py ├── system_prompt_concise.txt ├── use_hf_auth_token.txt └── utils.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/README.md -------------------------------------------------------------------------------- /generation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/generation.py -------------------------------------------------------------------------------- /init_environ.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/init_environ.sh -------------------------------------------------------------------------------- /openai_key.txt: -------------------------------------------------------------------------------- 1 | Put your openai key here -------------------------------------------------------------------------------- /parsing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/parsing.py -------------------------------------------------------------------------------- /requirements_csenv.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/requirements_csenv.txt -------------------------------------------------------------------------------- /requirements_fsenv.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/requirements_fsenv.txt -------------------------------------------------------------------------------- /scoring/confidence_scoring/atomic_fact_to_q.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/scoring/confidence_scoring/atomic_fact_to_q.py -------------------------------------------------------------------------------- /scoring/confidence_scoring/atomic_sample_answers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/scoring/confidence_scoring/atomic_sample_answers.py -------------------------------------------------------------------------------- /scoring/confidence_scoring/compute_confidence_score_bio.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/scoring/confidence_scoring/compute_confidence_score_bio.sh -------------------------------------------------------------------------------- /scoring/confidence_scoring/entity_sample.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/scoring/confidence_scoring/entity_sample.py -------------------------------------------------------------------------------- /scoring/confidence_scoring/score_metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/scoring/confidence_scoring/score_metrics.py -------------------------------------------------------------------------------- /scoring/confidence_scoring/utils_atomic_q.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/scoring/confidence_scoring/utils_atomic_q.py -------------------------------------------------------------------------------- /scoring/confidence_scoring/utils_atomic_sample.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/scoring/confidence_scoring/utils_atomic_sample.py -------------------------------------------------------------------------------- /scoring/factscoring/compute_factscore_bio.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/scoring/factscoring/compute_factscore_bio.sh -------------------------------------------------------------------------------- /scoring/factscoring/run_factscoring.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/scoring/factscoring/run_factscoring.py -------------------------------------------------------------------------------- /system_prompt_concise.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/system_prompt_concise.txt -------------------------------------------------------------------------------- /use_hf_auth_token.txt: -------------------------------------------------------------------------------- 1 | Put your hugging face token here -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/kttian/llm_factuality_tuning/HEAD/utils.py --------------------------------------------------------------------------------