├── README.md ├── conf └── llama_65b_merit_v1_pv91_v91_v5_0_full.yaml ├── convert2ckpt.py ├── data ├── data_utils.py ├── flan.py └── test.py ├── general_util └── tokenization_utils.py ├── models └── llama_ds_mp_wrap.py ├── requirements.txt └── trainer_base_ds_mp.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SparkJiao/llama-pipeline-parallel/HEAD/README.md -------------------------------------------------------------------------------- /conf/llama_65b_merit_v1_pv91_v91_v5_0_full.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SparkJiao/llama-pipeline-parallel/HEAD/conf/llama_65b_merit_v1_pv91_v91_v5_0_full.yaml -------------------------------------------------------------------------------- /convert2ckpt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SparkJiao/llama-pipeline-parallel/HEAD/convert2ckpt.py -------------------------------------------------------------------------------- /data/data_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SparkJiao/llama-pipeline-parallel/HEAD/data/data_utils.py -------------------------------------------------------------------------------- /data/flan.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SparkJiao/llama-pipeline-parallel/HEAD/data/flan.py -------------------------------------------------------------------------------- /data/test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SparkJiao/llama-pipeline-parallel/HEAD/data/test.py -------------------------------------------------------------------------------- /general_util/tokenization_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SparkJiao/llama-pipeline-parallel/HEAD/general_util/tokenization_utils.py -------------------------------------------------------------------------------- /models/llama_ds_mp_wrap.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SparkJiao/llama-pipeline-parallel/HEAD/models/llama_ds_mp_wrap.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SparkJiao/llama-pipeline-parallel/HEAD/requirements.txt -------------------------------------------------------------------------------- /trainer_base_ds_mp.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SparkJiao/llama-pipeline-parallel/HEAD/trainer_base_ds_mp.py --------------------------------------------------------------------------------