├── LICENSE ├── Notebooks ├── ContPreTrain-Peft-quantize.ipynb ├── Datasets.ipynb ├── PreTraining_GPT.ipynb ├── Task-Specific-FineTuning-LoRA.ipynb ├── Task-Specific-FineTuning.ipynb ├── Tokenizer.ipynb ├── eval_mmlu_cli.py ├── images │ ├── Lora_train_loss.png │ ├── Lora_validation_loss.png │ ├── ft_last_layer_llama321b.png │ ├── gpt2_mmlu_scores.png │ ├── info.txt │ ├── llama_ft_lora_loss_plot.png │ ├── lora_1.png │ ├── pipeline.png │ ├── sample_out.png │ ├── trainer.png │ ├── training_loop.png │ └── training_loss.png ├── readme.txt └── requirements.txt └── README.md /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/LICENSE -------------------------------------------------------------------------------- /Notebooks/ContPreTrain-Peft-quantize.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/ContPreTrain-Peft-quantize.ipynb -------------------------------------------------------------------------------- /Notebooks/Datasets.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/Datasets.ipynb -------------------------------------------------------------------------------- /Notebooks/PreTraining_GPT.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/PreTraining_GPT.ipynb -------------------------------------------------------------------------------- /Notebooks/Task-Specific-FineTuning-LoRA.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/Task-Specific-FineTuning-LoRA.ipynb -------------------------------------------------------------------------------- /Notebooks/Task-Specific-FineTuning.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/Task-Specific-FineTuning.ipynb -------------------------------------------------------------------------------- /Notebooks/Tokenizer.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/Tokenizer.ipynb -------------------------------------------------------------------------------- /Notebooks/eval_mmlu_cli.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/eval_mmlu_cli.py -------------------------------------------------------------------------------- /Notebooks/images/Lora_train_loss.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/Lora_train_loss.png -------------------------------------------------------------------------------- /Notebooks/images/Lora_validation_loss.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/Lora_validation_loss.png -------------------------------------------------------------------------------- /Notebooks/images/ft_last_layer_llama321b.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/ft_last_layer_llama321b.png -------------------------------------------------------------------------------- /Notebooks/images/gpt2_mmlu_scores.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/gpt2_mmlu_scores.png -------------------------------------------------------------------------------- /Notebooks/images/info.txt: -------------------------------------------------------------------------------- 1 | All images used in the notebook are stored here. 2 | -------------------------------------------------------------------------------- /Notebooks/images/llama_ft_lora_loss_plot.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/llama_ft_lora_loss_plot.png -------------------------------------------------------------------------------- /Notebooks/images/lora_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/lora_1.png -------------------------------------------------------------------------------- /Notebooks/images/pipeline.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/pipeline.png -------------------------------------------------------------------------------- /Notebooks/images/sample_out.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/sample_out.png -------------------------------------------------------------------------------- /Notebooks/images/trainer.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/trainer.png -------------------------------------------------------------------------------- /Notebooks/images/training_loop.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/training_loop.png -------------------------------------------------------------------------------- /Notebooks/images/training_loss.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/images/training_loss.png -------------------------------------------------------------------------------- /Notebooks/readme.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/readme.txt -------------------------------------------------------------------------------- /Notebooks/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/Notebooks/requirements.txt -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Arunprakash-A/Modern-NLP-with-Hugging-Face/HEAD/README.md --------------------------------------------------------------------------------