├── .gitignore ├── README.MD ├── args.MD ├── assets ├── 1.png └── 2.png ├── config ├── __init__.py ├── colossalai_strategy.yaml ├── deepspeed.yaml ├── deepspeed_offload.yaml ├── global.yaml ├── main.py ├── petl.yaml ├── train_ac.yaml ├── train_cl.yaml ├── train_hf.yaml └── train_pl.yaml ├── data ├── moss2qa.py └── train.json ├── data_processer.py ├── data_utils.py ├── docker ├── Dockerfile └── README.md ├── infer ├── __init__.py ├── evaluate.py ├── infer.py ├── infer_finetuning.py ├── infer_lora_finetuning.py ├── infer_muti_lora_finetuning.py └── infer_ptuning.py ├── requirements.txt ├── scripts ├── train_full.sh ├── train_lora.sh ├── train_lora_int4.sh ├── train_lora_int8.sh └── train_ptv2.sh ├── train.py └── training ├── __init__.py ├── train_ac.py ├── train_cl.py ├── train_hf.py └── train_pl.py /.gitignore: -------------------------------------------------------------------------------- 1 | /.idea 2 | /__pycache__ 3 | -------------------------------------------------------------------------------- /README.MD: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/README.MD -------------------------------------------------------------------------------- /args.MD: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/args.MD -------------------------------------------------------------------------------- /assets/1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/assets/1.png -------------------------------------------------------------------------------- /assets/2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/assets/2.png -------------------------------------------------------------------------------- /config/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/__init__.py -------------------------------------------------------------------------------- /config/colossalai_strategy.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/colossalai_strategy.yaml -------------------------------------------------------------------------------- /config/deepspeed.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/deepspeed.yaml -------------------------------------------------------------------------------- /config/deepspeed_offload.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/deepspeed_offload.yaml -------------------------------------------------------------------------------- /config/global.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/global.yaml -------------------------------------------------------------------------------- /config/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/main.py -------------------------------------------------------------------------------- /config/petl.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/petl.yaml -------------------------------------------------------------------------------- /config/train_ac.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/train_ac.yaml -------------------------------------------------------------------------------- /config/train_cl.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/train_cl.yaml -------------------------------------------------------------------------------- /config/train_hf.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/train_hf.yaml -------------------------------------------------------------------------------- /config/train_pl.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/config/train_pl.yaml -------------------------------------------------------------------------------- /data/moss2qa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/data/moss2qa.py -------------------------------------------------------------------------------- /data/train.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/data/train.json -------------------------------------------------------------------------------- /data_processer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/data_processer.py -------------------------------------------------------------------------------- /data_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/data_utils.py -------------------------------------------------------------------------------- /docker/Dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/docker/Dockerfile -------------------------------------------------------------------------------- /docker/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/docker/README.md -------------------------------------------------------------------------------- /infer/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/infer/__init__.py -------------------------------------------------------------------------------- /infer/evaluate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/infer/evaluate.py -------------------------------------------------------------------------------- /infer/infer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/infer/infer.py -------------------------------------------------------------------------------- /infer/infer_finetuning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/infer/infer_finetuning.py -------------------------------------------------------------------------------- /infer/infer_lora_finetuning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/infer/infer_lora_finetuning.py -------------------------------------------------------------------------------- /infer/infer_muti_lora_finetuning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/infer/infer_muti_lora_finetuning.py -------------------------------------------------------------------------------- /infer/infer_ptuning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/infer/infer_ptuning.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/requirements.txt -------------------------------------------------------------------------------- /scripts/train_full.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/scripts/train_full.sh -------------------------------------------------------------------------------- /scripts/train_lora.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/scripts/train_lora.sh -------------------------------------------------------------------------------- /scripts/train_lora_int4.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/scripts/train_lora_int4.sh -------------------------------------------------------------------------------- /scripts/train_lora_int8.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/scripts/train_lora_int8.sh -------------------------------------------------------------------------------- /scripts/train_ptv2.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/scripts/train_ptv2.sh -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/train.py -------------------------------------------------------------------------------- /training/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/training/__init__.py -------------------------------------------------------------------------------- /training/train_ac.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/training/train_ac.py -------------------------------------------------------------------------------- /training/train_cl.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/training/train_cl.py -------------------------------------------------------------------------------- /training/train_hf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/training/train_hf.py -------------------------------------------------------------------------------- /training/train_pl.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ssbuild/moss_finetuning/HEAD/training/train_pl.py --------------------------------------------------------------------------------