├── .DS_Store ├── .gitignore ├── LICENSE ├── README.md ├── data ├── cleaned_dataset.jsonl ├── formatted_dataset.jsonl └── reddit_dataset.jsonl ├── lora_finetune ├── .DS_Store ├── convert_to_gguf.py ├── dadAI_inference_test.ipynb ├── inference.py ├── inference_batch.py ├── lora_finetune │ ├── .DS_Store │ └── data │ │ ├── data-00000-of-00001.arrow │ │ ├── dataset_info.json │ │ └── state.json ├── merge_lora.py ├── outputs │ └── lora_weights.zip ├── prepare_dataset.py ├── requirements.txt └── train.py ├── requirements.txt ├── scripts ├── .DS_Store ├── Makefile ├── check_dataset_format.py ├── clean_dataset.py ├── collect_reddit_data.py ├── format_reddit_data.py ├── show_random_sample.py ├── test_reddit_connection.py └── test_tiny_llm.py └── tests └── Prompt dadAI.png /.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/.DS_Store -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/README.md -------------------------------------------------------------------------------- /data/cleaned_dataset.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/data/cleaned_dataset.jsonl -------------------------------------------------------------------------------- /data/formatted_dataset.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/data/formatted_dataset.jsonl -------------------------------------------------------------------------------- /data/reddit_dataset.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/data/reddit_dataset.jsonl -------------------------------------------------------------------------------- /lora_finetune/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/.DS_Store -------------------------------------------------------------------------------- /lora_finetune/convert_to_gguf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/convert_to_gguf.py -------------------------------------------------------------------------------- /lora_finetune/dadAI_inference_test.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/dadAI_inference_test.ipynb -------------------------------------------------------------------------------- /lora_finetune/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/inference.py -------------------------------------------------------------------------------- /lora_finetune/inference_batch.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/inference_batch.py -------------------------------------------------------------------------------- /lora_finetune/lora_finetune/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/lora_finetune/.DS_Store -------------------------------------------------------------------------------- /lora_finetune/lora_finetune/data/data-00000-of-00001.arrow: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/lora_finetune/data/data-00000-of-00001.arrow -------------------------------------------------------------------------------- /lora_finetune/lora_finetune/data/dataset_info.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/lora_finetune/data/dataset_info.json -------------------------------------------------------------------------------- /lora_finetune/lora_finetune/data/state.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/lora_finetune/data/state.json -------------------------------------------------------------------------------- /lora_finetune/merge_lora.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/merge_lora.py -------------------------------------------------------------------------------- /lora_finetune/outputs/lora_weights.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/outputs/lora_weights.zip -------------------------------------------------------------------------------- /lora_finetune/prepare_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/prepare_dataset.py -------------------------------------------------------------------------------- /lora_finetune/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/requirements.txt -------------------------------------------------------------------------------- /lora_finetune/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/lora_finetune/train.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/requirements.txt -------------------------------------------------------------------------------- /scripts/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/scripts/.DS_Store -------------------------------------------------------------------------------- /scripts/Makefile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/scripts/Makefile -------------------------------------------------------------------------------- /scripts/check_dataset_format.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/scripts/check_dataset_format.py -------------------------------------------------------------------------------- /scripts/clean_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/scripts/clean_dataset.py -------------------------------------------------------------------------------- /scripts/collect_reddit_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/scripts/collect_reddit_data.py -------------------------------------------------------------------------------- /scripts/format_reddit_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/scripts/format_reddit_data.py -------------------------------------------------------------------------------- /scripts/show_random_sample.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/scripts/show_random_sample.py -------------------------------------------------------------------------------- /scripts/test_reddit_connection.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/scripts/test_reddit_connection.py -------------------------------------------------------------------------------- /scripts/test_tiny_llm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/scripts/test_tiny_llm.py -------------------------------------------------------------------------------- /tests/Prompt dadAI.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/brossign/dadAI/HEAD/tests/Prompt dadAI.png --------------------------------------------------------------------------------