├── .vscode └── settings.json ├── LICENSE ├── README.md ├── assets └── SP-Laser-benchmark.png ├── examples ├── laser-dolphin-mixtral-2x7b.ipynb └── semantic-performance-laser.ipynb ├── laserQlora.ipynb ├── laser_scanner.py ├── laser_scanner_mac.py ├── lib ├── __init__.py └── utils │ ├── AutoModelForSentenceEmbedding.py │ ├── __pycache__ │ └── gptq_data_utils.cpython-311.pyc │ ├── assets.py │ ├── gptq_data_utils.py │ ├── gptq_data_utils_math.py │ ├── load_benchmark_dataset.py │ └── prompt_template.py ├── model_results ├── readme.md ├── snr_results_Meta-Llama-3-70B.json ├── snr_results_Meta-Llama-3-8B.json ├── snr_results_Mistral-7B-v0.1.json ├── snr_results_Mistral-7B-v0.2.json ├── snr_results_Mixtral-8x22B-v0.1.json ├── snr_results_Qwen1.5-32B.json ├── snr_results_c4ai-command-r-plus.json └── snr_results_grok.json ├── requirements.txt ├── requirements_mac.txt ├── rmt_laser.py ├── rmt_laser_dpo.py ├── rmt_laser_snr.py ├── rmt_laser_snr_math.py ├── rmt_laser_snr_math_mac_mixtral.py └── script_lm_eval.sh /.vscode/settings.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/.vscode/settings.json -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/README.md -------------------------------------------------------------------------------- /assets/SP-Laser-benchmark.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/assets/SP-Laser-benchmark.png -------------------------------------------------------------------------------- /examples/laser-dolphin-mixtral-2x7b.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/examples/laser-dolphin-mixtral-2x7b.ipynb -------------------------------------------------------------------------------- /examples/semantic-performance-laser.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/examples/semantic-performance-laser.ipynb -------------------------------------------------------------------------------- /laserQlora.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/laserQlora.ipynb -------------------------------------------------------------------------------- /laser_scanner.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/laser_scanner.py -------------------------------------------------------------------------------- /laser_scanner_mac.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/laser_scanner_mac.py -------------------------------------------------------------------------------- /lib/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /lib/utils/AutoModelForSentenceEmbedding.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/lib/utils/AutoModelForSentenceEmbedding.py -------------------------------------------------------------------------------- /lib/utils/__pycache__/gptq_data_utils.cpython-311.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/lib/utils/__pycache__/gptq_data_utils.cpython-311.pyc -------------------------------------------------------------------------------- /lib/utils/assets.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/lib/utils/assets.py -------------------------------------------------------------------------------- /lib/utils/gptq_data_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/lib/utils/gptq_data_utils.py -------------------------------------------------------------------------------- /lib/utils/gptq_data_utils_math.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/lib/utils/gptq_data_utils_math.py -------------------------------------------------------------------------------- /lib/utils/load_benchmark_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/lib/utils/load_benchmark_dataset.py -------------------------------------------------------------------------------- /lib/utils/prompt_template.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/lib/utils/prompt_template.py -------------------------------------------------------------------------------- /model_results/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/model_results/readme.md -------------------------------------------------------------------------------- /model_results/snr_results_Meta-Llama-3-70B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/model_results/snr_results_Meta-Llama-3-70B.json -------------------------------------------------------------------------------- /model_results/snr_results_Meta-Llama-3-8B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/model_results/snr_results_Meta-Llama-3-8B.json -------------------------------------------------------------------------------- /model_results/snr_results_Mistral-7B-v0.1.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/model_results/snr_results_Mistral-7B-v0.1.json -------------------------------------------------------------------------------- /model_results/snr_results_Mistral-7B-v0.2.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/model_results/snr_results_Mistral-7B-v0.2.json -------------------------------------------------------------------------------- /model_results/snr_results_Mixtral-8x22B-v0.1.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/model_results/snr_results_Mixtral-8x22B-v0.1.json -------------------------------------------------------------------------------- /model_results/snr_results_Qwen1.5-32B.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/model_results/snr_results_Qwen1.5-32B.json -------------------------------------------------------------------------------- /model_results/snr_results_c4ai-command-r-plus.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/model_results/snr_results_c4ai-command-r-plus.json -------------------------------------------------------------------------------- /model_results/snr_results_grok.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/model_results/snr_results_grok.json -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/requirements.txt -------------------------------------------------------------------------------- /requirements_mac.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/requirements_mac.txt -------------------------------------------------------------------------------- /rmt_laser.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/rmt_laser.py -------------------------------------------------------------------------------- /rmt_laser_dpo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/rmt_laser_dpo.py -------------------------------------------------------------------------------- /rmt_laser_snr.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/rmt_laser_snr.py -------------------------------------------------------------------------------- /rmt_laser_snr_math.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/rmt_laser_snr_math.py -------------------------------------------------------------------------------- /rmt_laser_snr_math_mac_mixtral.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/rmt_laser_snr_math_mac_mixtral.py -------------------------------------------------------------------------------- /script_lm_eval.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/QuixiAI/laserRMT/HEAD/script_lm_eval.sh --------------------------------------------------------------------------------