├── .gitignore ├── .travis.yml ├── LICENSE ├── README.md ├── images ├── cifar_test.png ├── cifar_train.png ├── lr_dependency_adam.png ├── mlp_test.png ├── mlp_train.png ├── simple_optm_adam.png └── simple_optm_sgd.png ├── notebooks ├── cifar_cnn.ipynb ├── mnist_mlp.ipynb ├── simple_optimization.ipynb └── utils │ └── callbacks.py ├── optimizer.py ├── requirements.txt ├── test_clipped_optimizer.py └── test_normalized_optimizer.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/.gitignore -------------------------------------------------------------------------------- /.travis.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/.travis.yml -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/README.md -------------------------------------------------------------------------------- /images/cifar_test.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/images/cifar_test.png -------------------------------------------------------------------------------- /images/cifar_train.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/images/cifar_train.png -------------------------------------------------------------------------------- /images/lr_dependency_adam.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/images/lr_dependency_adam.png -------------------------------------------------------------------------------- /images/mlp_test.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/images/mlp_test.png -------------------------------------------------------------------------------- /images/mlp_train.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/images/mlp_train.png -------------------------------------------------------------------------------- /images/simple_optm_adam.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/images/simple_optm_adam.png -------------------------------------------------------------------------------- /images/simple_optm_sgd.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/images/simple_optm_sgd.png -------------------------------------------------------------------------------- /notebooks/cifar_cnn.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/notebooks/cifar_cnn.ipynb -------------------------------------------------------------------------------- /notebooks/mnist_mlp.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/notebooks/mnist_mlp.ipynb -------------------------------------------------------------------------------- /notebooks/simple_optimization.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/notebooks/simple_optimization.ipynb -------------------------------------------------------------------------------- /notebooks/utils/callbacks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/notebooks/utils/callbacks.py -------------------------------------------------------------------------------- /optimizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/optimizer.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | keras 2 | h5py 3 | -------------------------------------------------------------------------------- /test_clipped_optimizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/test_clipped_optimizer.py -------------------------------------------------------------------------------- /test_normalized_optimizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/titu1994/keras-normalized-optimizers/HEAD/test_normalized_optimizer.py --------------------------------------------------------------------------------