├── .gitignore ├── LICENSE ├── README.md ├── apply_delta.py ├── data ├── alpaca_data_gpt4.json ├── arc_sft.json ├── data_lm.py ├── geobench │ ├── geobench_apstudy.json │ └── geobench_npee.json ├── geosignal │ └── geosignal.json └── natural_instructions_cleaned.json ├── ds_config_zero.json ├── evaluation ├── README.md ├── multiple_choice_samples.txt ├── multiple_choice_samples_wa.txt ├── post_process.py └── run_eval.py ├── export_hf_checkpoint.py ├── export_state_dict_checkpoint.py ├── finetune.py ├── generation ├── README.md ├── generate.py └── input_ls.json ├── k2.yaml ├── run_clm.py ├── run_clm_resume.py ├── templates ├── README.md ├── alpaca.json ├── alpaca_legacy.json ├── alpaca_short.json └── vigogne.json └── utils ├── README.md ├── __init__.py ├── callbacks.py └── prompter.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/README.md -------------------------------------------------------------------------------- /apply_delta.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/apply_delta.py -------------------------------------------------------------------------------- /data/alpaca_data_gpt4.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/data/alpaca_data_gpt4.json -------------------------------------------------------------------------------- /data/arc_sft.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/data/arc_sft.json -------------------------------------------------------------------------------- /data/data_lm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/data/data_lm.py -------------------------------------------------------------------------------- /data/geobench/geobench_apstudy.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/data/geobench/geobench_apstudy.json -------------------------------------------------------------------------------- /data/geobench/geobench_npee.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/data/geobench/geobench_npee.json -------------------------------------------------------------------------------- /data/geosignal/geosignal.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/data/geosignal/geosignal.json -------------------------------------------------------------------------------- /data/natural_instructions_cleaned.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/data/natural_instructions_cleaned.json -------------------------------------------------------------------------------- /ds_config_zero.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/ds_config_zero.json -------------------------------------------------------------------------------- /evaluation/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/evaluation/README.md -------------------------------------------------------------------------------- /evaluation/multiple_choice_samples.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/evaluation/multiple_choice_samples.txt -------------------------------------------------------------------------------- /evaluation/multiple_choice_samples_wa.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/evaluation/multiple_choice_samples_wa.txt -------------------------------------------------------------------------------- /evaluation/post_process.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/evaluation/post_process.py -------------------------------------------------------------------------------- /evaluation/run_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/evaluation/run_eval.py -------------------------------------------------------------------------------- /export_hf_checkpoint.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/export_hf_checkpoint.py -------------------------------------------------------------------------------- /export_state_dict_checkpoint.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/export_state_dict_checkpoint.py -------------------------------------------------------------------------------- /finetune.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/finetune.py -------------------------------------------------------------------------------- /generation/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/generation/README.md -------------------------------------------------------------------------------- /generation/generate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/generation/generate.py -------------------------------------------------------------------------------- /generation/input_ls.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/generation/input_ls.json -------------------------------------------------------------------------------- /k2.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/k2.yaml -------------------------------------------------------------------------------- /run_clm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/run_clm.py -------------------------------------------------------------------------------- /run_clm_resume.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/run_clm_resume.py -------------------------------------------------------------------------------- /templates/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/templates/README.md -------------------------------------------------------------------------------- /templates/alpaca.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/templates/alpaca.json -------------------------------------------------------------------------------- /templates/alpaca_legacy.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/templates/alpaca_legacy.json -------------------------------------------------------------------------------- /templates/alpaca_short.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/templates/alpaca_short.json -------------------------------------------------------------------------------- /templates/vigogne.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/templates/vigogne.json -------------------------------------------------------------------------------- /utils/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/utils/README.md -------------------------------------------------------------------------------- /utils/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /utils/callbacks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/utils/callbacks.py -------------------------------------------------------------------------------- /utils/prompter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/davendw49/k2/HEAD/utils/prompter.py --------------------------------------------------------------------------------