├── .DS_Store ├── .ipynb_checkpoints └── main-checkpoint.ipynb ├── LICENSE ├── README.md ├── figures ├── .DS_Store ├── control.png ├── games1.gif ├── games2.gif └── games3.gif ├── logs ├── base_reward_log_Acrobot-v1_1.txt ├── base_reward_log_Acrobot-v1_2024.txt ├── base_reward_log_CartPole-v1_2024.txt ├── base_reward_log_LunarLander-v2_2024.txt ├── trac_Acrobot-v1.text ├── trac_CartPole-v1.text ├── trac_LunarLander-v2.text ├── trac_reward_log_Acrobot-v1_2024.txt ├── trac_reward_log_CartPole-v1_2024.txt └── trac_reward_log_LunarLander-v2_2024.txt ├── main.ipynb ├── package ├── LICENSE ├── README.md ├── dist │ ├── trac_optimizer-0.0.2-py3-none-any.whl │ └── trac_optimizer-0.0.2.tar.gz ├── pyproject.toml └── src │ └── trac_optimizer │ ├── __init__.py │ ├── experimental │ └── jax │ │ └── trac.py │ └── trac.py ├── requirements.txt ├── trac.py └── vision_exp ├── .DS_Store ├── __pycache__ └── pace.cpython-310.pyc ├── agents ├── __init__.py ├── __pycache__ │ ├── __init__.cpython-310.pyc │ ├── base_agent.cpython-310.pyc │ └── ppo.cpython-310.pyc ├── base_agent.py └── ppo.py ├── common ├── __init__.py ├── __pycache__ │ ├── __init__.cpython-310.pyc │ ├── logger.cpython-310.pyc │ ├── misc_util.cpython-310.pyc │ ├── model.cpython-310.pyc │ ├── model_crelu.cpython-310.pyc │ ├── policy.cpython-310.pyc │ └── storage.cpython-310.pyc ├── env │ ├── __init__.py │ ├── __pycache__ │ │ ├── __init__.cpython-310.pyc │ │ ├── atari_wrappers.cpython-310.pyc │ │ └── procgen_wrappers.cpython-310.pyc │ ├── atari_wrappers.py │ ├── parallel_env.py │ └── procgen_wrappers.py ├── logger.py ├── misc_util.py ├── model.py ├── policy.py └── storage.py └── train.py /.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/.DS_Store -------------------------------------------------------------------------------- /.ipynb_checkpoints/main-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/.ipynb_checkpoints/main-checkpoint.ipynb -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/README.md -------------------------------------------------------------------------------- /figures/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/figures/.DS_Store -------------------------------------------------------------------------------- /figures/control.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/figures/control.png -------------------------------------------------------------------------------- /figures/games1.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/figures/games1.gif -------------------------------------------------------------------------------- /figures/games2.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/figures/games2.gif -------------------------------------------------------------------------------- /figures/games3.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/figures/games3.gif -------------------------------------------------------------------------------- /logs/base_reward_log_Acrobot-v1_1.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/logs/base_reward_log_Acrobot-v1_1.txt -------------------------------------------------------------------------------- /logs/base_reward_log_Acrobot-v1_2024.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/logs/base_reward_log_Acrobot-v1_2024.txt -------------------------------------------------------------------------------- /logs/base_reward_log_CartPole-v1_2024.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/logs/base_reward_log_CartPole-v1_2024.txt -------------------------------------------------------------------------------- /logs/base_reward_log_LunarLander-v2_2024.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/logs/base_reward_log_LunarLander-v2_2024.txt -------------------------------------------------------------------------------- /logs/trac_Acrobot-v1.text: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/logs/trac_Acrobot-v1.text -------------------------------------------------------------------------------- /logs/trac_CartPole-v1.text: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/logs/trac_CartPole-v1.text -------------------------------------------------------------------------------- /logs/trac_LunarLander-v2.text: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/logs/trac_LunarLander-v2.text -------------------------------------------------------------------------------- /logs/trac_reward_log_Acrobot-v1_2024.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/logs/trac_reward_log_Acrobot-v1_2024.txt -------------------------------------------------------------------------------- /logs/trac_reward_log_CartPole-v1_2024.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/logs/trac_reward_log_CartPole-v1_2024.txt -------------------------------------------------------------------------------- /logs/trac_reward_log_LunarLander-v2_2024.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/logs/trac_reward_log_LunarLander-v2_2024.txt -------------------------------------------------------------------------------- /main.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/main.ipynb -------------------------------------------------------------------------------- /package/LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/package/LICENSE -------------------------------------------------------------------------------- /package/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/package/README.md -------------------------------------------------------------------------------- /package/dist/trac_optimizer-0.0.2-py3-none-any.whl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/package/dist/trac_optimizer-0.0.2-py3-none-any.whl -------------------------------------------------------------------------------- /package/dist/trac_optimizer-0.0.2.tar.gz: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/package/dist/trac_optimizer-0.0.2.tar.gz -------------------------------------------------------------------------------- /package/pyproject.toml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/package/pyproject.toml -------------------------------------------------------------------------------- /package/src/trac_optimizer/__init__.py: -------------------------------------------------------------------------------- 1 | from .trac import start_trac 2 | -------------------------------------------------------------------------------- /package/src/trac_optimizer/experimental/jax/trac.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/package/src/trac_optimizer/experimental/jax/trac.py -------------------------------------------------------------------------------- /package/src/trac_optimizer/trac.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/package/src/trac_optimizer/trac.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | torch 2 | numpy 3 | seaborn 4 | tqdm 5 | gym[box2d] 6 | swig 7 | procgen 8 | -------------------------------------------------------------------------------- /trac.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/trac.py -------------------------------------------------------------------------------- /vision_exp/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/.DS_Store -------------------------------------------------------------------------------- /vision_exp/__pycache__/pace.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/__pycache__/pace.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/agents/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /vision_exp/agents/__pycache__/__init__.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/agents/__pycache__/__init__.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/agents/__pycache__/base_agent.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/agents/__pycache__/base_agent.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/agents/__pycache__/ppo.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/agents/__pycache__/ppo.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/agents/base_agent.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/agents/base_agent.py -------------------------------------------------------------------------------- /vision_exp/agents/ppo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/agents/ppo.py -------------------------------------------------------------------------------- /vision_exp/common/__init__.py: -------------------------------------------------------------------------------- 1 | from .misc_util import * -------------------------------------------------------------------------------- /vision_exp/common/__pycache__/__init__.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/__pycache__/__init__.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/common/__pycache__/logger.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/__pycache__/logger.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/common/__pycache__/misc_util.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/__pycache__/misc_util.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/common/__pycache__/model.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/__pycache__/model.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/common/__pycache__/model_crelu.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/__pycache__/model_crelu.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/common/__pycache__/policy.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/__pycache__/policy.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/common/__pycache__/storage.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/__pycache__/storage.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/common/env/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /vision_exp/common/env/__pycache__/__init__.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/env/__pycache__/__init__.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/common/env/__pycache__/atari_wrappers.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/env/__pycache__/atari_wrappers.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/common/env/__pycache__/procgen_wrappers.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/env/__pycache__/procgen_wrappers.cpython-310.pyc -------------------------------------------------------------------------------- /vision_exp/common/env/atari_wrappers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/env/atari_wrappers.py -------------------------------------------------------------------------------- /vision_exp/common/env/parallel_env.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/env/parallel_env.py -------------------------------------------------------------------------------- /vision_exp/common/env/procgen_wrappers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/env/procgen_wrappers.py -------------------------------------------------------------------------------- /vision_exp/common/logger.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/logger.py -------------------------------------------------------------------------------- /vision_exp/common/misc_util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/misc_util.py -------------------------------------------------------------------------------- /vision_exp/common/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/model.py -------------------------------------------------------------------------------- /vision_exp/common/policy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/policy.py -------------------------------------------------------------------------------- /vision_exp/common/storage.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/common/storage.py -------------------------------------------------------------------------------- /vision_exp/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ComputationalRobotics/TRAC/HEAD/vision_exp/train.py --------------------------------------------------------------------------------