├── .idea └── .gitignore ├── Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs ├── DatasetCreationFromDisentQA.py ├── DatasetCreationWithoutContext.py ├── InfoModelUsingWrapper.py ├── InteventionByDetection.py ├── LICENSE ├── ModelInside.py ├── README.md ├── RunAllSteps.py ├── datasets │ ├── GeneralDisentQAWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json │ ├── GeneralDisentQAWithThreshold1.0llama2-7b.json │ ├── GeneralTrivia_qa_no_contextWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json │ ├── GeneralTrivia_qa_no_contextWithThreshold1.0llama2-7b.json │ ├── HallucinateDisentQAWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json │ ├── HallucinateDisentQAWithThreshold1.0llama2-7b.json │ ├── HallucinateTrivia_qa_no_contextWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json │ ├── HallucinateTrivia_qa_no_contextWithThreshold1.0llama2-7b.json │ ├── LICENSE │ ├── NonHallucinateDisentQAWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json │ ├── NonHallucinateDisentQAWithThreshold1.0llama2-7b.json │ ├── NonHallucinateTrivia_qa_no_contextWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json │ └── NonHallucinateTrivia_qa_no_contextWithThreshold1.0llama2-7b.json ├── environment.yml └── models_config.py ├── Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations ├── DatasetCreationWithoutContext.py ├── InfoModelUsingWrapper.py ├── LICENSE ├── ModelInside.py ├── README.md ├── RunAllSteps.py ├── datasets │ ├── AliceGeneralNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── AliceGeneralNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── AliceGeneralNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── AliceGeneralTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── AliceGeneralTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── AliceGeneralTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── AliceHallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── AliceHallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── AliceHallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── AliceHallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── AliceHallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── AliceHallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── AliceNonHallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── AliceNonHallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── AliceNonHallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── AliceNonHallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── AliceNonHallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── AliceNonHallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── AliceStaticNatural_qa_no_context.json │ ├── AliceStaticTrivia_qa_no_context.json │ ├── GeneralNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── GeneralNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── GeneralNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── GeneralTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── GeneralTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── GeneralTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── HallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── HallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── HallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── HallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── HallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── HallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── LICENSE │ ├── NonHallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── NonHallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── NonHallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── NonHallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json │ ├── NonHallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json │ ├── NonHallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json │ ├── StaticNatural_qa_no_context.json │ └── StaticTrivia_qa_no_context.json ├── environment.yml ├── models_config.py └── plot_results.py └── README.md /.idea/.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/.idea/.gitignore -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/DatasetCreationFromDisentQA.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/DatasetCreationFromDisentQA.py -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/DatasetCreationWithoutContext.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/DatasetCreationWithoutContext.py -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/InfoModelUsingWrapper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/InfoModelUsingWrapper.py -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/InteventionByDetection.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/InteventionByDetection.py -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/LICENSE -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/ModelInside.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/ModelInside.py -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/README.md -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/RunAllSteps.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/RunAllSteps.py -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/GeneralDisentQAWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/GeneralDisentQAWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/GeneralDisentQAWithThreshold1.0llama2-7b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/GeneralDisentQAWithThreshold1.0llama2-7b.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/GeneralTrivia_qa_no_contextWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/GeneralTrivia_qa_no_contextWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/GeneralTrivia_qa_no_contextWithThreshold1.0llama2-7b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/GeneralTrivia_qa_no_contextWithThreshold1.0llama2-7b.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/HallucinateDisentQAWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/HallucinateDisentQAWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/HallucinateDisentQAWithThreshold1.0llama2-7b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/HallucinateDisentQAWithThreshold1.0llama2-7b.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/HallucinateTrivia_qa_no_contextWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/HallucinateTrivia_qa_no_contextWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/HallucinateTrivia_qa_no_contextWithThreshold1.0llama2-7b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/HallucinateTrivia_qa_no_contextWithThreshold1.0llama2-7b.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/LICENSE -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/NonHallucinateDisentQAWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/NonHallucinateDisentQAWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/NonHallucinateDisentQAWithThreshold1.0llama2-7b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/NonHallucinateDisentQAWithThreshold1.0llama2-7b.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/NonHallucinateTrivia_qa_no_contextWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/NonHallucinateTrivia_qa_no_contextWithThreshold1.0_GOAT-AI_GOAT-7B-Community.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/NonHallucinateTrivia_qa_no_contextWithThreshold1.0llama2-7b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/datasets/NonHallucinateTrivia_qa_no_contextWithThreshold1.0llama2-7b.json -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/environment.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/environment.yml -------------------------------------------------------------------------------- /Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/models_config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Constructing_Benchmarks_and_Interventions_for_Combating_Hallucinations_in_LLMs/models_config.py -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/DatasetCreationWithoutContext.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/DatasetCreationWithoutContext.py -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/InfoModelUsingWrapper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/InfoModelUsingWrapper.py -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/LICENSE -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/ModelInside.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/ModelInside.py -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/README.md -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/RunAllSteps.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/RunAllSteps.py -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceGeneralTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceHallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceNonHallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceStaticNatural_qa_no_context.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceStaticNatural_qa_no_context.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceStaticTrivia_qa_no_context.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/AliceStaticTrivia_qa_no_context.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/GeneralTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/HallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/LICENSE -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateNatural_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateNatural_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateNatural_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateTrivia_qa_no_contextWithThreshold1.0_google_gemma-2-9b.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateTrivia_qa_no_contextWithThreshold1.0_meta-llama_Meta-Llama-3.1-8B.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/NonHallucinateTrivia_qa_no_contextWithThreshold1.0_mistralai_Mistral-7B-v0.3.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/StaticNatural_qa_no_context.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/StaticNatural_qa_no_context.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/StaticTrivia_qa_no_context.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/datasets/StaticTrivia_qa_no_context.json -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/environment.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/environment.yml -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/models_config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/models_config.py -------------------------------------------------------------------------------- /Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/plot_results.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/Distinguishing_Ignorance_from_Error_in_LLM_Hallucinations/plot_results.py -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/technion-cs-nlp/hallucination-mitigation/HEAD/README.md --------------------------------------------------------------------------------