├── README.md ├── categories.py ├── evaluate_mmlu.py ├── imgs └── overview.png ├── integer quantizer ├── README.md ├── peft_utils_iec.py └── quantizer_icq.py ├── irlora.py ├── requirements.txt ├── scripts ├── evaluate_mmlu.sh └── finetune.sh └── utils.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/README.md -------------------------------------------------------------------------------- /categories.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/categories.py -------------------------------------------------------------------------------- /evaluate_mmlu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/evaluate_mmlu.py -------------------------------------------------------------------------------- /imgs/overview.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/imgs/overview.png -------------------------------------------------------------------------------- /integer quantizer/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/integer quantizer/README.md -------------------------------------------------------------------------------- /integer quantizer/peft_utils_iec.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/integer quantizer/peft_utils_iec.py -------------------------------------------------------------------------------- /integer quantizer/quantizer_icq.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/integer quantizer/quantizer_icq.py -------------------------------------------------------------------------------- /irlora.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/irlora.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/requirements.txt -------------------------------------------------------------------------------- /scripts/evaluate_mmlu.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/scripts/evaluate_mmlu.sh -------------------------------------------------------------------------------- /scripts/finetune.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/scripts/finetune.sh -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/htqin/IR-QLoRA/HEAD/utils.py --------------------------------------------------------------------------------