├── .gitignore ├── LICENSE ├── README.md ├── cifar10.py ├── fsdp_optimizers ├── __init__.py ├── kron.py ├── kron_mars.py ├── muon.py ├── soap.py └── utils.py └── setup.py /.gitignore: -------------------------------------------------------------------------------- 1 | __pycache__ 2 | data 3 | batch_file.sh 4 | salloc_* -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ethansmith2000/fsdp_optimizers/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ethansmith2000/fsdp_optimizers/HEAD/README.md -------------------------------------------------------------------------------- /cifar10.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ethansmith2000/fsdp_optimizers/HEAD/cifar10.py -------------------------------------------------------------------------------- /fsdp_optimizers/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ethansmith2000/fsdp_optimizers/HEAD/fsdp_optimizers/__init__.py -------------------------------------------------------------------------------- /fsdp_optimizers/kron.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ethansmith2000/fsdp_optimizers/HEAD/fsdp_optimizers/kron.py -------------------------------------------------------------------------------- /fsdp_optimizers/kron_mars.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ethansmith2000/fsdp_optimizers/HEAD/fsdp_optimizers/kron_mars.py -------------------------------------------------------------------------------- /fsdp_optimizers/muon.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ethansmith2000/fsdp_optimizers/HEAD/fsdp_optimizers/muon.py -------------------------------------------------------------------------------- /fsdp_optimizers/soap.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ethansmith2000/fsdp_optimizers/HEAD/fsdp_optimizers/soap.py -------------------------------------------------------------------------------- /fsdp_optimizers/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ethansmith2000/fsdp_optimizers/HEAD/fsdp_optimizers/utils.py -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ethansmith2000/fsdp_optimizers/HEAD/setup.py --------------------------------------------------------------------------------