├── .gitignore ├── Makefile ├── README.md ├── Serialization-timing.ipynb ├── __init__.py ├── mpi_comms.py ├── ps.py ├── serialization.py ├── test_comms.py ├── test_iallgather.py └── test_mpi.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/stsievert/pytorch_ps_mpi/HEAD/.gitignore -------------------------------------------------------------------------------- /Makefile: -------------------------------------------------------------------------------- 1 | 2 | test: 3 | mpirun -n 2 py.test -s 4 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/stsievert/pytorch_ps_mpi/HEAD/README.md -------------------------------------------------------------------------------- /Serialization-timing.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/stsievert/pytorch_ps_mpi/HEAD/Serialization-timing.ipynb -------------------------------------------------------------------------------- /__init__.py: -------------------------------------------------------------------------------- 1 | from .ps import MPI_PS, Adam, SGD 2 | -------------------------------------------------------------------------------- /mpi_comms.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/stsievert/pytorch_ps_mpi/HEAD/mpi_comms.py -------------------------------------------------------------------------------- /ps.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/stsievert/pytorch_ps_mpi/HEAD/ps.py -------------------------------------------------------------------------------- /serialization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/stsievert/pytorch_ps_mpi/HEAD/serialization.py -------------------------------------------------------------------------------- /test_comms.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/stsievert/pytorch_ps_mpi/HEAD/test_comms.py -------------------------------------------------------------------------------- /test_iallgather.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/stsievert/pytorch_ps_mpi/HEAD/test_iallgather.py -------------------------------------------------------------------------------- /test_mpi.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/stsievert/pytorch_ps_mpi/HEAD/test_mpi.py --------------------------------------------------------------------------------