├── LICENSE ├── README.md ├── data ├── data_sample.jsonl └── demos │ └── few_shot_examples.jsonl ├── prompt ├── extraction_alpaca_template.txt ├── extraction_non_qa_template.txt ├── extraction_qa_template.txt ├── non_qa_template.txt ├── qa_template.txt ├── verification_alpaca_template.txt ├── verification_instruction_binary.txt ├── verification_instruction_binary_no_demo.txt ├── verification_instruction_claude_binary.txt ├── verification_instruction_claude_trinary.txt └── verification_instruction_trinary.txt ├── setup.py └── veriscore ├── __init__.py ├── __pycache__ ├── ClaimExtractor.cpython-39.pyc ├── ClaimVerifier.cpython-39.pyc ├── GetResponse.cpython-39.pyc ├── SearchAPI.cpython-39.pyc ├── __init__.cpython-39.pyc ├── claim_extraction_prompt_utils.cpython-39.pyc ├── claim_extractor.cpython-39.pyc ├── claim_verifier.cpython-39.pyc ├── evidence_retrieval.cpython-39.pyc ├── extract_claims.cpython-39.pyc ├── get_response.cpython-39.pyc ├── instruction.cpython-39.pyc ├── instruction_claude.cpython-39.pyc ├── retrieval_evidence.cpython-39.pyc ├── search_API.cpython-39.pyc ├── verify_claims.cpython-39.pyc └── veriscore.cpython-39.pyc ├── claim_extractor.py ├── claim_verifier.py ├── extract_claims.py ├── get_response.py ├── retrieve_evidence.py ├── search_API.py ├── utils.py ├── verify_claims.py └── veriscore.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/README.md -------------------------------------------------------------------------------- /data/data_sample.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/data/data_sample.jsonl -------------------------------------------------------------------------------- /data/demos/few_shot_examples.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/data/demos/few_shot_examples.jsonl -------------------------------------------------------------------------------- /prompt/extraction_alpaca_template.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/extraction_alpaca_template.txt -------------------------------------------------------------------------------- /prompt/extraction_non_qa_template.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/extraction_non_qa_template.txt -------------------------------------------------------------------------------- /prompt/extraction_qa_template.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/extraction_qa_template.txt -------------------------------------------------------------------------------- /prompt/non_qa_template.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/non_qa_template.txt -------------------------------------------------------------------------------- /prompt/qa_template.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/qa_template.txt -------------------------------------------------------------------------------- /prompt/verification_alpaca_template.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/verification_alpaca_template.txt -------------------------------------------------------------------------------- /prompt/verification_instruction_binary.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/verification_instruction_binary.txt -------------------------------------------------------------------------------- /prompt/verification_instruction_binary_no_demo.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/verification_instruction_binary_no_demo.txt -------------------------------------------------------------------------------- /prompt/verification_instruction_claude_binary.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/verification_instruction_claude_binary.txt -------------------------------------------------------------------------------- /prompt/verification_instruction_claude_trinary.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/verification_instruction_claude_trinary.txt -------------------------------------------------------------------------------- /prompt/verification_instruction_trinary.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/prompt/verification_instruction_trinary.txt -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/setup.py -------------------------------------------------------------------------------- /veriscore/__init__.py: -------------------------------------------------------------------------------- 1 | __version__ = '2.0.2' 2 | -------------------------------------------------------------------------------- /veriscore/__pycache__/ClaimExtractor.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/ClaimExtractor.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/ClaimVerifier.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/ClaimVerifier.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/GetResponse.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/GetResponse.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/SearchAPI.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/SearchAPI.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/__init__.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/__init__.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/claim_extraction_prompt_utils.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/claim_extraction_prompt_utils.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/claim_extractor.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/claim_extractor.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/claim_verifier.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/claim_verifier.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/evidence_retrieval.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/evidence_retrieval.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/extract_claims.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/extract_claims.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/get_response.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/get_response.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/instruction.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/instruction.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/instruction_claude.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/instruction_claude.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/retrieval_evidence.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/retrieval_evidence.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/search_API.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/search_API.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/verify_claims.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/verify_claims.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/__pycache__/veriscore.cpython-39.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/__pycache__/veriscore.cpython-39.pyc -------------------------------------------------------------------------------- /veriscore/claim_extractor.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/claim_extractor.py -------------------------------------------------------------------------------- /veriscore/claim_verifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/claim_verifier.py -------------------------------------------------------------------------------- /veriscore/extract_claims.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/extract_claims.py -------------------------------------------------------------------------------- /veriscore/get_response.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/get_response.py -------------------------------------------------------------------------------- /veriscore/retrieve_evidence.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/retrieve_evidence.py -------------------------------------------------------------------------------- /veriscore/search_API.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/search_API.py -------------------------------------------------------------------------------- /veriscore/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/utils.py -------------------------------------------------------------------------------- /veriscore/verify_claims.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/verify_claims.py -------------------------------------------------------------------------------- /veriscore/veriscore.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Yixiao-Song/VeriScore/HEAD/veriscore/veriscore.py --------------------------------------------------------------------------------