├── .env.example ├── .gitignore ├── Makefile ├── README.md ├── assets ├── error_asyncio_timeout.png ├── error_could_not_find_a_group_error.png ├── error_download_state_from_peers.png └── error_failed_to_connect_to_DHT.png ├── distributed_training ├── __init__.py ├── averaging │ ├── averagers.py │ ├── avg_handler.py │ └── exceptions.py ├── base │ ├── __init__.py │ ├── miner.py │ ├── neuron.py │ └── validator.py ├── data │ └── dataset.py ├── protocol.py ├── scripts │ └── cleanup_r2_bucket.py ├── utils │ ├── __init__.py │ ├── chain.py │ ├── compression.py │ ├── config.py │ ├── dendrite.py │ ├── dist.py │ ├── logger.py │ ├── misc.py │ ├── progress_tracker.py │ ├── r2.py │ ├── state_loader.py │ ├── uids.py │ ├── upload_worker.py │ └── weight_utils.py └── validator │ ├── __init__.py │ ├── forward.py │ └── reward.py ├── eval └── eval_loss.py ├── min.compute.yml ├── neurons ├── __init__.py ├── miner.py └── validator.py ├── pyproject.toml ├── requirements.txt ├── run_miner.sh ├── run_validator.sh └── setup.py /.env.example: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/.env.example -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/.gitignore -------------------------------------------------------------------------------- /Makefile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/Makefile -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/README.md -------------------------------------------------------------------------------- /assets/error_asyncio_timeout.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/assets/error_asyncio_timeout.png -------------------------------------------------------------------------------- /assets/error_could_not_find_a_group_error.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/assets/error_could_not_find_a_group_error.png -------------------------------------------------------------------------------- /assets/error_download_state_from_peers.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/assets/error_download_state_from_peers.png -------------------------------------------------------------------------------- /assets/error_failed_to_connect_to_DHT.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/assets/error_failed_to_connect_to_DHT.png -------------------------------------------------------------------------------- /distributed_training/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/__init__.py -------------------------------------------------------------------------------- /distributed_training/averaging/averagers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/averaging/averagers.py -------------------------------------------------------------------------------- /distributed_training/averaging/avg_handler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/averaging/avg_handler.py -------------------------------------------------------------------------------- /distributed_training/averaging/exceptions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/averaging/exceptions.py -------------------------------------------------------------------------------- /distributed_training/base/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /distributed_training/base/miner.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/base/miner.py -------------------------------------------------------------------------------- /distributed_training/base/neuron.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/base/neuron.py -------------------------------------------------------------------------------- /distributed_training/base/validator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/base/validator.py -------------------------------------------------------------------------------- /distributed_training/data/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/data/dataset.py -------------------------------------------------------------------------------- /distributed_training/protocol.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/protocol.py -------------------------------------------------------------------------------- /distributed_training/scripts/cleanup_r2_bucket.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/scripts/cleanup_r2_bucket.py -------------------------------------------------------------------------------- /distributed_training/utils/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/__init__.py -------------------------------------------------------------------------------- /distributed_training/utils/chain.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/chain.py -------------------------------------------------------------------------------- /distributed_training/utils/compression.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/compression.py -------------------------------------------------------------------------------- /distributed_training/utils/config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/config.py -------------------------------------------------------------------------------- /distributed_training/utils/dendrite.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/dendrite.py -------------------------------------------------------------------------------- /distributed_training/utils/dist.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/dist.py -------------------------------------------------------------------------------- /distributed_training/utils/logger.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/logger.py -------------------------------------------------------------------------------- /distributed_training/utils/misc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/misc.py -------------------------------------------------------------------------------- /distributed_training/utils/progress_tracker.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/progress_tracker.py -------------------------------------------------------------------------------- /distributed_training/utils/r2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/r2.py -------------------------------------------------------------------------------- /distributed_training/utils/state_loader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/state_loader.py -------------------------------------------------------------------------------- /distributed_training/utils/uids.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/uids.py -------------------------------------------------------------------------------- /distributed_training/utils/upload_worker.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/upload_worker.py -------------------------------------------------------------------------------- /distributed_training/utils/weight_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/utils/weight_utils.py -------------------------------------------------------------------------------- /distributed_training/validator/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/validator/__init__.py -------------------------------------------------------------------------------- /distributed_training/validator/forward.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/validator/forward.py -------------------------------------------------------------------------------- /distributed_training/validator/reward.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/distributed_training/validator/reward.py -------------------------------------------------------------------------------- /eval/eval_loss.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/eval/eval_loss.py -------------------------------------------------------------------------------- /min.compute.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/min.compute.yml -------------------------------------------------------------------------------- /neurons/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /neurons/miner.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/neurons/miner.py -------------------------------------------------------------------------------- /neurons/validator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/neurons/validator.py -------------------------------------------------------------------------------- /pyproject.toml: -------------------------------------------------------------------------------- 1 | [tool.black] 2 | line-length = 88 -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/requirements.txt -------------------------------------------------------------------------------- /run_miner.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/run_miner.sh -------------------------------------------------------------------------------- /run_validator.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/run_validator.sh -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/dstrbtd/DistributedTraining/HEAD/setup.py --------------------------------------------------------------------------------