├── .gitignore ├── LICENSE ├── README.md ├── autograd_4bit.py ├── download-model.py ├── fake_qa_prompt.txt ├── fake_trivia_questions.json ├── filter_questions.py ├── generate_trivia.py ├── hq_trivia_questions.json ├── matmul_utils_4bit.py ├── nota_qa_prompt.txt ├── nota_trivia_questions.json ├── requirements.txt ├── results ├── test_results_fake_trivia_questions.json_alpaca-lora-4bit.txt ├── test_results_fake_trivia_questions.json_gpt4all-4bit.txt ├── test_results_fake_trivia_questions.json_llama-7b-hf-4bit.txt ├── test_results_fake_trivia_questions.json_text-davinci-002.txt ├── test_results_fake_trivia_questions.json_text-davinci-003.txt ├── test_results_hq_trivia_questions.json_alpaca-lora-4bit.txt ├── test_results_hq_trivia_questions.json_gpt4all-4bit.txt ├── test_results_hq_trivia_questions.json_llama-7b-hf-4bit.txt ├── test_results_hq_trivia_questions.json_text-davinci-002.txt ├── test_results_hq_trivia_questions.json_text-davinci-003.txt ├── test_results_nota_trivia_questions.json_alpaca-lora-4bit.txt ├── test_results_nota_trivia_questions.json_gpt4all-4bit.txt ├── test_results_nota_trivia_questions.json_llama-7b-hf-4bit.txt ├── test_results_nota_trivia_questions.json_text-davinci-002.txt ├── test_results_nota_trivia_questions.json_text-davinci-003.txt ├── test_results_truthfulqa_trivia_questions.json_alpaca-lora-4bit.txt ├── test_results_truthfulqa_trivia_questions.json_gpt4all-4bit.txt ├── test_results_truthfulqa_trivia_questions.json_llama-4bit.txt ├── test_results_truthfulqa_trivia_questions.json_text-davinci-002.txt └── test_results_truthfulqa_trivia_questions.json_text-davinci-003.txt ├── take_test.py └── truthfulqa_trivia_questions.json /.gitignore: -------------------------------------------------------------------------------- 1 | .utils 2 | __pycache__ 3 | models 4 | loras 5 | weights 6 | -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/README.md -------------------------------------------------------------------------------- /autograd_4bit.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/autograd_4bit.py -------------------------------------------------------------------------------- /download-model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/download-model.py -------------------------------------------------------------------------------- /fake_qa_prompt.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/fake_qa_prompt.txt -------------------------------------------------------------------------------- /fake_trivia_questions.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/fake_trivia_questions.json -------------------------------------------------------------------------------- /filter_questions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/filter_questions.py -------------------------------------------------------------------------------- /generate_trivia.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/generate_trivia.py -------------------------------------------------------------------------------- /hq_trivia_questions.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/hq_trivia_questions.json -------------------------------------------------------------------------------- /matmul_utils_4bit.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/matmul_utils_4bit.py -------------------------------------------------------------------------------- /nota_qa_prompt.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/nota_qa_prompt.txt -------------------------------------------------------------------------------- /nota_trivia_questions.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/nota_trivia_questions.json -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/requirements.txt -------------------------------------------------------------------------------- /results/test_results_fake_trivia_questions.json_alpaca-lora-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_fake_trivia_questions.json_alpaca-lora-4bit.txt -------------------------------------------------------------------------------- /results/test_results_fake_trivia_questions.json_gpt4all-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_fake_trivia_questions.json_gpt4all-4bit.txt -------------------------------------------------------------------------------- /results/test_results_fake_trivia_questions.json_llama-7b-hf-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_fake_trivia_questions.json_llama-7b-hf-4bit.txt -------------------------------------------------------------------------------- /results/test_results_fake_trivia_questions.json_text-davinci-002.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_fake_trivia_questions.json_text-davinci-002.txt -------------------------------------------------------------------------------- /results/test_results_fake_trivia_questions.json_text-davinci-003.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_fake_trivia_questions.json_text-davinci-003.txt -------------------------------------------------------------------------------- /results/test_results_hq_trivia_questions.json_alpaca-lora-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_hq_trivia_questions.json_alpaca-lora-4bit.txt -------------------------------------------------------------------------------- /results/test_results_hq_trivia_questions.json_gpt4all-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_hq_trivia_questions.json_gpt4all-4bit.txt -------------------------------------------------------------------------------- /results/test_results_hq_trivia_questions.json_llama-7b-hf-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_hq_trivia_questions.json_llama-7b-hf-4bit.txt -------------------------------------------------------------------------------- /results/test_results_hq_trivia_questions.json_text-davinci-002.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_hq_trivia_questions.json_text-davinci-002.txt -------------------------------------------------------------------------------- /results/test_results_hq_trivia_questions.json_text-davinci-003.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_hq_trivia_questions.json_text-davinci-003.txt -------------------------------------------------------------------------------- /results/test_results_nota_trivia_questions.json_alpaca-lora-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_nota_trivia_questions.json_alpaca-lora-4bit.txt -------------------------------------------------------------------------------- /results/test_results_nota_trivia_questions.json_gpt4all-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_nota_trivia_questions.json_gpt4all-4bit.txt -------------------------------------------------------------------------------- /results/test_results_nota_trivia_questions.json_llama-7b-hf-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_nota_trivia_questions.json_llama-7b-hf-4bit.txt -------------------------------------------------------------------------------- /results/test_results_nota_trivia_questions.json_text-davinci-002.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_nota_trivia_questions.json_text-davinci-002.txt -------------------------------------------------------------------------------- /results/test_results_nota_trivia_questions.json_text-davinci-003.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_nota_trivia_questions.json_text-davinci-003.txt -------------------------------------------------------------------------------- /results/test_results_truthfulqa_trivia_questions.json_alpaca-lora-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_truthfulqa_trivia_questions.json_alpaca-lora-4bit.txt -------------------------------------------------------------------------------- /results/test_results_truthfulqa_trivia_questions.json_gpt4all-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_truthfulqa_trivia_questions.json_gpt4all-4bit.txt -------------------------------------------------------------------------------- /results/test_results_truthfulqa_trivia_questions.json_llama-4bit.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_truthfulqa_trivia_questions.json_llama-4bit.txt -------------------------------------------------------------------------------- /results/test_results_truthfulqa_trivia_questions.json_text-davinci-002.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_truthfulqa_trivia_questions.json_text-davinci-002.txt -------------------------------------------------------------------------------- /results/test_results_truthfulqa_trivia_questions.json_text-davinci-003.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/results/test_results_truthfulqa_trivia_questions.json_text-davinci-003.txt -------------------------------------------------------------------------------- /take_test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/take_test.py -------------------------------------------------------------------------------- /truthfulqa_trivia_questions.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manyoso/haltt4llm/HEAD/truthfulqa_trivia_questions.json --------------------------------------------------------------------------------