├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── LICENSE ├── README.md ├── examples └── mnist │ ├── README.md │ ├── main.py │ └── requirements.txt ├── pyproject.toml ├── requirements.txt └── schedulefree ├── __init__.py ├── adamw_schedulefree.py ├── adamw_schedulefree_closure.py ├── adamw_schedulefree_paper.py ├── adamw_schedulefree_reference.py ├── algoperf ├── external_tuning │ ├── schedule_free_adamw │ │ ├── requirements.txt │ │ ├── submission.py │ │ └── tuning_search_space.json │ └── schedule_free_prodigy │ │ ├── requirements.txt │ │ ├── submission.py │ │ └── tuning_search_space.json └── self_tuning │ └── schedule_free_adamw │ ├── requirements.txt │ └── submission.py ├── radam_schedulefree.py ├── radam_schedulefree_closure.py ├── sgd_schedulefree.py ├── sgd_schedulefree_closure.py ├── sgd_schedulefree_reference.py ├── test_schedulefree.py ├── wrap_schedulefree.py └── wrap_schedulefree_reference.py /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/CONTRIBUTING.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/README.md -------------------------------------------------------------------------------- /examples/mnist/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/examples/mnist/README.md -------------------------------------------------------------------------------- /examples/mnist/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/examples/mnist/main.py -------------------------------------------------------------------------------- /examples/mnist/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/examples/mnist/requirements.txt -------------------------------------------------------------------------------- /pyproject.toml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/pyproject.toml -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | torch >= 2.0 2 | typing_extensions 3 | -------------------------------------------------------------------------------- /schedulefree/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/__init__.py -------------------------------------------------------------------------------- /schedulefree/adamw_schedulefree.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/adamw_schedulefree.py -------------------------------------------------------------------------------- /schedulefree/adamw_schedulefree_closure.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/adamw_schedulefree_closure.py -------------------------------------------------------------------------------- /schedulefree/adamw_schedulefree_paper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/adamw_schedulefree_paper.py -------------------------------------------------------------------------------- /schedulefree/adamw_schedulefree_reference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/adamw_schedulefree_reference.py -------------------------------------------------------------------------------- /schedulefree/algoperf/external_tuning/schedule_free_adamw/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/algoperf/external_tuning/schedule_free_adamw/requirements.txt -------------------------------------------------------------------------------- /schedulefree/algoperf/external_tuning/schedule_free_adamw/submission.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/algoperf/external_tuning/schedule_free_adamw/submission.py -------------------------------------------------------------------------------- /schedulefree/algoperf/external_tuning/schedule_free_adamw/tuning_search_space.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/algoperf/external_tuning/schedule_free_adamw/tuning_search_space.json -------------------------------------------------------------------------------- /schedulefree/algoperf/external_tuning/schedule_free_prodigy/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/algoperf/external_tuning/schedule_free_prodigy/requirements.txt -------------------------------------------------------------------------------- /schedulefree/algoperf/external_tuning/schedule_free_prodigy/submission.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/algoperf/external_tuning/schedule_free_prodigy/submission.py -------------------------------------------------------------------------------- /schedulefree/algoperf/external_tuning/schedule_free_prodigy/tuning_search_space.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/algoperf/external_tuning/schedule_free_prodigy/tuning_search_space.json -------------------------------------------------------------------------------- /schedulefree/algoperf/self_tuning/schedule_free_adamw/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/algoperf/self_tuning/schedule_free_adamw/requirements.txt -------------------------------------------------------------------------------- /schedulefree/algoperf/self_tuning/schedule_free_adamw/submission.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/algoperf/self_tuning/schedule_free_adamw/submission.py -------------------------------------------------------------------------------- /schedulefree/radam_schedulefree.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/radam_schedulefree.py -------------------------------------------------------------------------------- /schedulefree/radam_schedulefree_closure.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/radam_schedulefree_closure.py -------------------------------------------------------------------------------- /schedulefree/sgd_schedulefree.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/sgd_schedulefree.py -------------------------------------------------------------------------------- /schedulefree/sgd_schedulefree_closure.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/sgd_schedulefree_closure.py -------------------------------------------------------------------------------- /schedulefree/sgd_schedulefree_reference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/sgd_schedulefree_reference.py -------------------------------------------------------------------------------- /schedulefree/test_schedulefree.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/test_schedulefree.py -------------------------------------------------------------------------------- /schedulefree/wrap_schedulefree.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/wrap_schedulefree.py -------------------------------------------------------------------------------- /schedulefree/wrap_schedulefree_reference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/schedule_free/HEAD/schedulefree/wrap_schedulefree_reference.py --------------------------------------------------------------------------------