├── LICENSE ├── README.md ├── experiment_code ├── .gitignore ├── README.md ├── conversation.py ├── convert_fsdp_to_hf.py ├── convert_hf_to_fsdp.py ├── dataset.py ├── datasets │ └── alpaca-train.jsonl ├── eval_generate.py ├── io_utils.py ├── preprocess_data.py ├── profile_loading.py ├── requirements.txt ├── scripts │ └── alpaca_eval.sh ├── train.py └── utils.py └── imgs └── AlpacaEval_Figue1.png /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/README.md -------------------------------------------------------------------------------- /experiment_code/.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/.gitignore -------------------------------------------------------------------------------- /experiment_code/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/README.md -------------------------------------------------------------------------------- /experiment_code/conversation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/conversation.py -------------------------------------------------------------------------------- /experiment_code/convert_fsdp_to_hf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/convert_fsdp_to_hf.py -------------------------------------------------------------------------------- /experiment_code/convert_hf_to_fsdp.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/convert_hf_to_fsdp.py -------------------------------------------------------------------------------- /experiment_code/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/dataset.py -------------------------------------------------------------------------------- /experiment_code/datasets/alpaca-train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/datasets/alpaca-train.jsonl -------------------------------------------------------------------------------- /experiment_code/eval_generate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/eval_generate.py -------------------------------------------------------------------------------- /experiment_code/io_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/io_utils.py -------------------------------------------------------------------------------- /experiment_code/preprocess_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/preprocess_data.py -------------------------------------------------------------------------------- /experiment_code/profile_loading.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/profile_loading.py -------------------------------------------------------------------------------- /experiment_code/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/requirements.txt -------------------------------------------------------------------------------- /experiment_code/scripts/alpaca_eval.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/scripts/alpaca_eval.sh -------------------------------------------------------------------------------- /experiment_code/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/train.py -------------------------------------------------------------------------------- /experiment_code/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/experiment_code/utils.py -------------------------------------------------------------------------------- /imgs/AlpacaEval_Figue1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/neelsjain/NEFTune/HEAD/imgs/AlpacaEval_Figue1.png --------------------------------------------------------------------------------