├── .gitignore ├── ACKTR.py ├── LICENSE ├── README.md ├── base_train.py ├── config └── breakout_config.json ├── envs ├── atari_wrappers.py ├── base_env.py ├── env_summary_logger.py ├── gym_env.py ├── monitor.py └── subproc_vec_env.py ├── layers.py ├── logger.py ├── main.py ├── models ├── base_policy.py ├── cnn_policy.py └── model.py ├── ops ├── curvature_matrix_vector_products.py ├── estimator.py ├── fisher_blocks.py ├── fisher_factors.py ├── layer_collection.py ├── loss_functions.py ├── op_queue.py ├── optimizer.py └── utils.py ├── train.py └── utils ├── lr_decay.py ├── utils.py └── variables_saver.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/.gitignore -------------------------------------------------------------------------------- /ACKTR.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/ACKTR.py -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/README.md -------------------------------------------------------------------------------- /base_train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/base_train.py -------------------------------------------------------------------------------- /config/breakout_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/config/breakout_config.json -------------------------------------------------------------------------------- /envs/atari_wrappers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/envs/atari_wrappers.py -------------------------------------------------------------------------------- /envs/base_env.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/envs/base_env.py -------------------------------------------------------------------------------- /envs/env_summary_logger.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/envs/env_summary_logger.py -------------------------------------------------------------------------------- /envs/gym_env.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/envs/gym_env.py -------------------------------------------------------------------------------- /envs/monitor.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/envs/monitor.py -------------------------------------------------------------------------------- /envs/subproc_vec_env.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/envs/subproc_vec_env.py -------------------------------------------------------------------------------- /layers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/layers.py -------------------------------------------------------------------------------- /logger.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/logger.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/main.py -------------------------------------------------------------------------------- /models/base_policy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/models/base_policy.py -------------------------------------------------------------------------------- /models/cnn_policy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/models/cnn_policy.py -------------------------------------------------------------------------------- /models/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/models/model.py -------------------------------------------------------------------------------- /ops/curvature_matrix_vector_products.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/ops/curvature_matrix_vector_products.py -------------------------------------------------------------------------------- /ops/estimator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/ops/estimator.py -------------------------------------------------------------------------------- /ops/fisher_blocks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/ops/fisher_blocks.py -------------------------------------------------------------------------------- /ops/fisher_factors.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/ops/fisher_factors.py -------------------------------------------------------------------------------- /ops/layer_collection.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/ops/layer_collection.py -------------------------------------------------------------------------------- /ops/loss_functions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/ops/loss_functions.py -------------------------------------------------------------------------------- /ops/op_queue.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/ops/op_queue.py -------------------------------------------------------------------------------- /ops/optimizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/ops/optimizer.py -------------------------------------------------------------------------------- /ops/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/ops/utils.py -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/train.py -------------------------------------------------------------------------------- /utils/lr_decay.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/utils/lr_decay.py -------------------------------------------------------------------------------- /utils/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/utils/utils.py -------------------------------------------------------------------------------- /utils/variables_saver.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gd-zhang/ACKTR/HEAD/utils/variables_saver.py --------------------------------------------------------------------------------