├── .gitattributes ├── LICENSE ├── README.md ├── base_script.py ├── data_utils.py ├── deepspeed_config.json ├── deepspeed_config.py ├── deepspeed_script.py ├── deepspeed_stable_diffusion.py ├── ds_ex1.py ├── ds_ex2.py ├── get_tcp_port.py ├── hostfile ├── run_dist.sh ├── run_single.sh ├── setup_env.sh └── wheels ├── cenots-7-x86_64 ├── Torch1.13.1 │ ├── README.md │ └── deepspeed-0.9.5+fc9e1ee-cp310-cp310-linux_x86_64.whl └── Torch2.0.1 │ ├── README.md │ └── deepspeed-0.9.5+fc9e1ee-cp310-cp310-linux_x86_64.whl └── ubuntu-2004-x86_64 ├── Torch1.13.1 ├── README.md └── deepspeed-0.9.5+fc9e1ee0-cp310-cp310-linux_x86_64.whl └── Torch2.0.1 ├── README.md └── deepspeed-0.9.5+fc9e1ee0-cp310-cp310-linux_x86_64.whl /.gitattributes: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/.gitattributes -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/README.md -------------------------------------------------------------------------------- /base_script.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/base_script.py -------------------------------------------------------------------------------- /data_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/data_utils.py -------------------------------------------------------------------------------- /deepspeed_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/deepspeed_config.json -------------------------------------------------------------------------------- /deepspeed_config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/deepspeed_config.py -------------------------------------------------------------------------------- /deepspeed_script.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/deepspeed_script.py -------------------------------------------------------------------------------- /deepspeed_stable_diffusion.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/deepspeed_stable_diffusion.py -------------------------------------------------------------------------------- /ds_ex1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/ds_ex1.py -------------------------------------------------------------------------------- /ds_ex2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/ds_ex2.py -------------------------------------------------------------------------------- /get_tcp_port.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/get_tcp_port.py -------------------------------------------------------------------------------- /hostfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/hostfile -------------------------------------------------------------------------------- /run_dist.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/run_dist.sh -------------------------------------------------------------------------------- /run_single.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/run_single.sh -------------------------------------------------------------------------------- /setup_env.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/setup_env.sh -------------------------------------------------------------------------------- /wheels/cenots-7-x86_64/Torch1.13.1/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/wheels/cenots-7-x86_64/Torch1.13.1/README.md -------------------------------------------------------------------------------- /wheels/cenots-7-x86_64/Torch1.13.1/deepspeed-0.9.5+fc9e1ee-cp310-cp310-linux_x86_64.whl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/wheels/cenots-7-x86_64/Torch1.13.1/deepspeed-0.9.5+fc9e1ee-cp310-cp310-linux_x86_64.whl -------------------------------------------------------------------------------- /wheels/cenots-7-x86_64/Torch2.0.1/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/wheels/cenots-7-x86_64/Torch2.0.1/README.md -------------------------------------------------------------------------------- /wheels/cenots-7-x86_64/Torch2.0.1/deepspeed-0.9.5+fc9e1ee-cp310-cp310-linux_x86_64.whl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/wheels/cenots-7-x86_64/Torch2.0.1/deepspeed-0.9.5+fc9e1ee-cp310-cp310-linux_x86_64.whl -------------------------------------------------------------------------------- /wheels/ubuntu-2004-x86_64/Torch1.13.1/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/wheels/ubuntu-2004-x86_64/Torch1.13.1/README.md -------------------------------------------------------------------------------- /wheels/ubuntu-2004-x86_64/Torch1.13.1/deepspeed-0.9.5+fc9e1ee0-cp310-cp310-linux_x86_64.whl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/wheels/ubuntu-2004-x86_64/Torch1.13.1/deepspeed-0.9.5+fc9e1ee0-cp310-cp310-linux_x86_64.whl -------------------------------------------------------------------------------- /wheels/ubuntu-2004-x86_64/Torch2.0.1/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/wheels/ubuntu-2004-x86_64/Torch2.0.1/README.md -------------------------------------------------------------------------------- /wheels/ubuntu-2004-x86_64/Torch2.0.1/deepspeed-0.9.5+fc9e1ee0-cp310-cp310-linux_x86_64.whl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/OvJat/DeepSpeedTutorial/HEAD/wheels/ubuntu-2004-x86_64/Torch2.0.1/deepspeed-0.9.5+fc9e1ee0-cp310-cp310-linux_x86_64.whl --------------------------------------------------------------------------------