├── .gitignore ├── LICENSE ├── README.md ├── base_network.py ├── bullet_cartpole.py ├── cartpole.gif ├── cartpole.png ├── ddpg_cartpole.py ├── deciles.py ├── dqn_cartpole.py ├── eg_render.png ├── event.proto ├── event_log.py ├── event_log_sample.push_in_one_dir.gif ├── exps ├── run_81.sh ├── run_82.sh ├── run_83.sh ├── run_84.sh ├── run_85.sh ├── run_86.sh ├── run_87.sh ├── run_89.sh ├── run_90.sh ├── run_91.sh ├── run_92.sh ├── run_93.sh ├── run_97.sh ├── run_98.sh └── runs_77_plot.sh ├── lrpg_cartpole.py ├── make_plots.sh ├── models ├── cart.urdf ├── ground.urdf └── pole.urdf ├── naf_cartpole.py ├── plots.R ├── random_action_agent.py ├── random_plots.R ├── replay_memory.py ├── replay_memory_test.py ├── run_diff.py ├── stitch_activations.py ├── u ├── parse_gradient_logging.py ├── parse_out.py ├── parse_out_ddpg.py ├── parse_out_eval.py ├── parse_out_eval_with_time.py ├── parse_out_naf.py ├── parse_runs.py ├── random_params.py └── test_render.py └── util.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/README.md -------------------------------------------------------------------------------- /base_network.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/base_network.py -------------------------------------------------------------------------------- /bullet_cartpole.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/bullet_cartpole.py -------------------------------------------------------------------------------- /cartpole.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/cartpole.gif -------------------------------------------------------------------------------- /cartpole.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/cartpole.png -------------------------------------------------------------------------------- /ddpg_cartpole.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/ddpg_cartpole.py -------------------------------------------------------------------------------- /deciles.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/deciles.py -------------------------------------------------------------------------------- /dqn_cartpole.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/dqn_cartpole.py -------------------------------------------------------------------------------- /eg_render.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/eg_render.png -------------------------------------------------------------------------------- /event.proto: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/event.proto -------------------------------------------------------------------------------- /event_log.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/event_log.py -------------------------------------------------------------------------------- /event_log_sample.push_in_one_dir.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/event_log_sample.push_in_one_dir.gif -------------------------------------------------------------------------------- /exps/run_81.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_81.sh -------------------------------------------------------------------------------- /exps/run_82.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_82.sh -------------------------------------------------------------------------------- /exps/run_83.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_83.sh -------------------------------------------------------------------------------- /exps/run_84.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_84.sh -------------------------------------------------------------------------------- /exps/run_85.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_85.sh -------------------------------------------------------------------------------- /exps/run_86.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_86.sh -------------------------------------------------------------------------------- /exps/run_87.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_87.sh -------------------------------------------------------------------------------- /exps/run_89.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_89.sh -------------------------------------------------------------------------------- /exps/run_90.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_90.sh -------------------------------------------------------------------------------- /exps/run_91.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_91.sh -------------------------------------------------------------------------------- /exps/run_92.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_92.sh -------------------------------------------------------------------------------- /exps/run_93.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_93.sh -------------------------------------------------------------------------------- /exps/run_97.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_97.sh -------------------------------------------------------------------------------- /exps/run_98.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/run_98.sh -------------------------------------------------------------------------------- /exps/runs_77_plot.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/exps/runs_77_plot.sh -------------------------------------------------------------------------------- /lrpg_cartpole.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/lrpg_cartpole.py -------------------------------------------------------------------------------- /make_plots.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/make_plots.sh -------------------------------------------------------------------------------- /models/cart.urdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/models/cart.urdf -------------------------------------------------------------------------------- /models/ground.urdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/models/ground.urdf -------------------------------------------------------------------------------- /models/pole.urdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/models/pole.urdf -------------------------------------------------------------------------------- /naf_cartpole.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/naf_cartpole.py -------------------------------------------------------------------------------- /plots.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/plots.R -------------------------------------------------------------------------------- /random_action_agent.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/random_action_agent.py -------------------------------------------------------------------------------- /random_plots.R: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/random_plots.R -------------------------------------------------------------------------------- /replay_memory.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/replay_memory.py -------------------------------------------------------------------------------- /replay_memory_test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/replay_memory_test.py -------------------------------------------------------------------------------- /run_diff.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/run_diff.py -------------------------------------------------------------------------------- /stitch_activations.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/stitch_activations.py -------------------------------------------------------------------------------- /u/parse_gradient_logging.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/u/parse_gradient_logging.py -------------------------------------------------------------------------------- /u/parse_out.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/u/parse_out.py -------------------------------------------------------------------------------- /u/parse_out_ddpg.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/u/parse_out_ddpg.py -------------------------------------------------------------------------------- /u/parse_out_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/u/parse_out_eval.py -------------------------------------------------------------------------------- /u/parse_out_eval_with_time.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/u/parse_out_eval_with_time.py -------------------------------------------------------------------------------- /u/parse_out_naf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/u/parse_out_naf.py -------------------------------------------------------------------------------- /u/parse_runs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/u/parse_runs.py -------------------------------------------------------------------------------- /u/random_params.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/u/random_params.py -------------------------------------------------------------------------------- /u/test_render.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/u/test_render.py -------------------------------------------------------------------------------- /util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/matpalm/cartpoleplusplus/HEAD/util.py --------------------------------------------------------------------------------