├── Grasshopper Files ├── yellow.gha ├── Reinforcement Learning Interface.gh └── Evolutionary Algorithm and Greedy Algorithm for SL-Blocks.gh ├── PPO-Experiments ├── PPO-2D CURVE │ ├── PPO-2D long curve open_100_9000__0 │ │ ├── model_3000_steps.zip │ │ ├── model_6000_steps.zip │ │ ├── model_9000_steps.zip │ │ └── PPO_1 │ │ │ └── events.out.tfevents.1623330246.DESKTOP-R94BB1V.344.0 │ ├── PPO-2D long curve open_100_9000__1 │ │ ├── model_3000_steps.zip │ │ ├── model_6000_steps.zip │ │ ├── model_9000_steps.zip │ │ └── PPO_1 │ │ │ └── events.out.tfevents.1623322905.DESKTOP-R94BB1V.5904.0 │ ├── PPO-2D short curve open_100_3000__0 │ │ ├── model_1000_steps.zip │ │ ├── model_2000_steps.zip │ │ ├── model_3000_steps.zip │ │ └── PPO_1 │ │ │ └── events.out.tfevents.1623313404.DESKTOP-R94BB1V.8540.0 │ └── PPO-2D short curve open_100_3000__1 │ │ ├── model_1000_steps.zip │ │ ├── model_2000_steps.zip │ │ ├── model_3000_steps.zip │ │ └── PPO_1 │ │ └── events.out.tfevents.1623313793.DESKTOP-R94BB1V.8540.1 └── PPO-3D CURVE │ ├── PPO-3D long curve open_256_12000__0 │ ├── model_3000_steps.zip │ ├── model_6000_steps.zip │ ├── model_9000_steps.zip │ ├── model_12000_steps.zip │ └── PPO_1 │ │ └── events.out.tfevents.1623342597.DESKTOP-R94BB1V.236.0 │ ├── PPO-3D long curve open_256_12000__1 │ ├── model_3000_steps.zip │ ├── model_6000_steps.zip │ ├── model_9000_steps.zip │ ├── model_12000_steps.zip │ └── PPO_1 │ │ └── events.out.tfevents.1623344757.DESKTOP-R94BB1V.236.1 │ ├── PPO-3D short curve open_100_3000__0 │ ├── model_1000_steps.zip │ ├── model_2000_steps.zip │ ├── model_3000_steps.zip │ └── PPO_1 │ │ └── events.out.tfevents.1623332324.DESKTOP-R94BB1V.16228.0 │ ├── PPO-3D short curve open_100_3000__1 │ ├── model_1000_steps.zip │ ├── model_2000_steps.zip │ ├── model_3000_steps.zip │ └── PPO_1 │ │ └── events.out.tfevents.1623331841.DESKTOP-R94BB1V.15840.0 │ ├── PPO-3D long curve closed_256_12000__0 │ ├── model_3000_steps.zip │ ├── model_6000_steps.zip │ ├── model_9000_steps.zip │ ├── model_12000_steps.zip │ └── PPO_1 │ │ └── events.out.tfevents.1623404400.DESKTOP-R94BB1V.8712.0 │ ├── PPO-3D long curve closed_256_12000__1 │ ├── model_3000_steps.zip │ ├── model_6000_steps.zip │ ├── model_9000_steps.zip │ ├── model_12000_steps.zip │ └── PPO_1 │ │ └── events.out.tfevents.1623408682.DESKTOP-R94BB1V.8712.2 │ ├── PPO-3D short curve closed_100_6000__0 │ ├── model_2000_steps.zip │ ├── model_4000_steps.zip │ ├── model_6000_steps.zip │ └── PPO_1 │ │ └── events.out.tfevents.1623418431.DESKTOP-R94BB1V.14792.1 │ └── PPO-3D short curve closed_100_6000__1 │ ├── model_2000_steps.zip │ ├── model_4000_steps.zip │ ├── model_6000_steps.zip │ └── PPO_1 │ └── events.out.tfevents.1623416233.DESKTOP-R94BB1V.9112.1 ├── DQN-Experiments ├── DQN-2D CURVE │ ├── DQN-2D long curve open_100_6000_seed213__0 │ │ ├── model_2000_steps.zip │ │ ├── model_4000_steps.zip │ │ ├── model_6000_steps.zip │ │ └── DQN_1 │ │ │ └── events.out.tfevents.1623425200.DESKTOP-R94BB1V.13172.0 │ ├── DQN-2D long curve open_100_6000_seed726__0 │ │ ├── model_2000_steps.zip │ │ ├── model_4000_steps.zip │ │ ├── model_6000_steps.zip │ │ └── DQN_1 │ │ │ └── events.out.tfevents.1623423607.DESKTOP-R94BB1V.16224.0 │ ├── DQN-2D short curve open_100_3000_seed16__0 │ │ ├── model_1000_steps.zip │ │ ├── model_2000_steps.zip │ │ ├── model_3000_steps.zip │ │ └── DQN_1 │ │ │ └── events.out.tfevents.1623422879.DESKTOP-R94BB1V.7332.0 │ └── DQN-2D short curve open_100_3000_seed892__0 │ │ ├── model_1000_steps.zip │ │ ├── model_2000_steps.zip │ │ ├── model_3000_steps.zip │ │ └── DQN_1 │ │ └── events.out.tfevents.1623245191.DESKTOP-R94BB1V.7580.0 └── DQN-3D CURVE │ ├── DQN-3D long curve open_100_9000_seed354__2 │ ├── model_3000_steps.zip │ ├── model_6000_steps.zip │ ├── model_9000_steps.zip │ └── DQN_1 │ │ └── events.out.tfevents.1622849076.DESKTOP-R94BB1V.6652.2 │ ├── DQN-3D long curve open_100_9000_seed973__0 │ ├── model_3000_steps.zip │ ├── model_6000_steps.zip │ ├── model_9000_steps.zip │ └── DQN_1 │ │ └── events.out.tfevents.1622842367.DESKTOP-R94BB1V.12936.0 │ ├── DQN-3D long curve closed_100_12000_seed13__4 │ ├── model_12000_steps.zip │ ├── model_3000_steps.zip │ ├── model_6000_steps.zip │ ├── model_9000_steps.zip │ └── DQN_1 │ │ └── events.out.tfevents.1623464885.DESKTOP-R94BB1V.9032.4 │ ├── DQN-3D long curve closed_100_12000_seed390__0 │ ├── model_3000_steps.zip │ ├── model_6000_steps.zip │ ├── model_9000_steps.zip │ ├── model_12000_steps.zip │ └── DQN_1 │ │ └── events.out.tfevents.1622760291.DESKTOP-R94BB1V.20000.3 │ ├── DQN-3D short curve closed_100_6000_seed75__0 │ ├── model_2000_steps.zip │ ├── model_4000_steps.zip │ ├── model_6000_steps.zip │ └── DQN_1 │ │ └── events.out.tfevents.1623443774.DESKTOP-R94BB1V.5892.0 │ ├── DQN-3D short curve closed_100_6000_seed950__4 │ ├── model_2000_steps.zip │ ├── model_4000_steps.zip │ ├── model_6000_steps.zip │ └── DQN_1 │ │ └── events.out.tfevents.1623450140.DESKTOP-R94BB1V.10980.4 │ ├── DQN-3D short curve open_100_3000_seed189__0 │ ├── model_1000_steps.zip │ ├── model_2000_steps.zip │ ├── model_3000_steps.zip │ └── DQN_1 │ │ └── events.out.tfevents.1623427089.DESKTOP-R94BB1V.16192.0 │ └── DQN-3D short curve open_100_3000_seed309__1 │ ├── model_1000_steps.zip │ ├── model_2000_steps.zip │ ├── model_3000_steps.zip │ └── DQN_1 │ └── events.out.tfevents.1623427621.DESKTOP-R94BB1V.16192.1 ├── LICENSE ├── .gitignore ├── README.md ├── Python Files ├── eval_PPO-training_for_SL-block.py ├── eval_DQN-training_for_SL-block.py ├── PPO-training_for_SL-block.py └── DQN-training_for_SL-block.py └── train-and-eval.py /Grasshopper Files/yellow.gha: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/Grasshopper Files/yellow.gha -------------------------------------------------------------------------------- /Grasshopper Files/Reinforcement Learning Interface.gh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/Grasshopper Files/Reinforcement Learning Interface.gh -------------------------------------------------------------------------------- /Grasshopper Files/Evolutionary Algorithm and Greedy Algorithm for SL-Blocks.gh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/Grasshopper Files/Evolutionary Algorithm and Greedy Algorithm for SL-Blocks.gh -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__0/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__0/model_3000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__0/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__0/model_6000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__0/model_9000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__0/model_9000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__1/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__1/model_3000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__1/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__1/model_6000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__1/model_9000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__1/model_9000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__0/model_1000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__0/model_1000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__0/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__0/model_2000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__0/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__0/model_3000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__1/model_1000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__1/model_1000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__1/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__1/model_2000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__1/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__1/model_3000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__0/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__0/model_3000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__0/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__0/model_6000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__0/model_9000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__0/model_9000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__1/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__1/model_3000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__1/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__1/model_6000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__1/model_9000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__1/model_9000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__0/model_1000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__0/model_1000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__0/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__0/model_2000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__0/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__0/model_3000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__1/model_1000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__1/model_1000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__1/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__1/model_2000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__1/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__1/model_3000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__0/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__0/model_3000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__0/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__0/model_6000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__0/model_9000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__0/model_9000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__1/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__1/model_3000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__1/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__1/model_6000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__1/model_9000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__1/model_9000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__0/model_12000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__0/model_12000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__1/model_12000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__1/model_12000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__0/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__0/model_2000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__0/model_4000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__0/model_4000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__0/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__0/model_6000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__1/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__1/model_2000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__1/model_4000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__1/model_4000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__1/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__1/model_6000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__0/model_12000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__0/model_12000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__1/model_12000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__1/model_12000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed213__0/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed213__0/model_2000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed213__0/model_4000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed213__0/model_4000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed213__0/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed213__0/model_6000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed726__0/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed726__0/model_2000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed726__0/model_4000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed726__0/model_4000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed726__0/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed726__0/model_6000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed16__0/model_1000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed16__0/model_1000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed16__0/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed16__0/model_2000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed16__0/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed16__0/model_3000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed354__2/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed354__2/model_3000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed354__2/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed354__2/model_6000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed354__2/model_9000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed354__2/model_9000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed973__0/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed973__0/model_3000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed973__0/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed973__0/model_6000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed973__0/model_9000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed973__0/model_9000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed892__0/model_1000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed892__0/model_1000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed892__0/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed892__0/model_2000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed892__0/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed892__0/model_3000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed13__4/model_12000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed13__4/model_12000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed13__4/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed13__4/model_3000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed13__4/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed13__4/model_6000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed13__4/model_9000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed13__4/model_9000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed390__0/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed390__0/model_3000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed390__0/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed390__0/model_6000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed390__0/model_9000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed390__0/model_9000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed75__0/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed75__0/model_2000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed75__0/model_4000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed75__0/model_4000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed75__0/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed75__0/model_6000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed950__4/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed950__4/model_2000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed950__4/model_4000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed950__4/model_4000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed950__4/model_6000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed950__4/model_6000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed189__0/model_1000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed189__0/model_1000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed189__0/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed189__0/model_2000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed189__0/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed189__0/model_3000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed309__1/model_1000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed309__1/model_1000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed309__1/model_2000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed309__1/model_2000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed309__1/model_3000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed309__1/model_3000_steps.zip -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed390__0/model_12000_steps.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed390__0/model_12000_steps.zip -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__0/PPO_1/events.out.tfevents.1623330246.DESKTOP-R94BB1V.344.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__0/PPO_1/events.out.tfevents.1623330246.DESKTOP-R94BB1V.344.0 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__1/PPO_1/events.out.tfevents.1623322905.DESKTOP-R94BB1V.5904.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D long curve open_100_9000__1/PPO_1/events.out.tfevents.1623322905.DESKTOP-R94BB1V.5904.0 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__0/PPO_1/events.out.tfevents.1623313404.DESKTOP-R94BB1V.8540.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__0/PPO_1/events.out.tfevents.1623313404.DESKTOP-R94BB1V.8540.0 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__1/PPO_1/events.out.tfevents.1623313793.DESKTOP-R94BB1V.8540.1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-2D CURVE/PPO-2D short curve open_100_3000__1/PPO_1/events.out.tfevents.1623313793.DESKTOP-R94BB1V.8540.1 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__0/PPO_1/events.out.tfevents.1623342597.DESKTOP-R94BB1V.236.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__0/PPO_1/events.out.tfevents.1623342597.DESKTOP-R94BB1V.236.0 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__1/PPO_1/events.out.tfevents.1623344757.DESKTOP-R94BB1V.236.1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve open_256_12000__1/PPO_1/events.out.tfevents.1623344757.DESKTOP-R94BB1V.236.1 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__0/PPO_1/events.out.tfevents.1623332324.DESKTOP-R94BB1V.16228.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__0/PPO_1/events.out.tfevents.1623332324.DESKTOP-R94BB1V.16228.0 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__1/PPO_1/events.out.tfevents.1623331841.DESKTOP-R94BB1V.15840.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve open_100_3000__1/PPO_1/events.out.tfevents.1623331841.DESKTOP-R94BB1V.15840.0 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__0/PPO_1/events.out.tfevents.1623404400.DESKTOP-R94BB1V.8712.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__0/PPO_1/events.out.tfevents.1623404400.DESKTOP-R94BB1V.8712.0 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__1/PPO_1/events.out.tfevents.1623408682.DESKTOP-R94BB1V.8712.2: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D long curve closed_256_12000__1/PPO_1/events.out.tfevents.1623408682.DESKTOP-R94BB1V.8712.2 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__0/PPO_1/events.out.tfevents.1623418431.DESKTOP-R94BB1V.14792.1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__0/PPO_1/events.out.tfevents.1623418431.DESKTOP-R94BB1V.14792.1 -------------------------------------------------------------------------------- /PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__1/PPO_1/events.out.tfevents.1623416233.DESKTOP-R94BB1V.9112.1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/PPO-Experiments/PPO-3D CURVE/PPO-3D short curve closed_100_6000__1/PPO_1/events.out.tfevents.1623416233.DESKTOP-R94BB1V.9112.1 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed213__0/DQN_1/events.out.tfevents.1623425200.DESKTOP-R94BB1V.13172.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed213__0/DQN_1/events.out.tfevents.1623425200.DESKTOP-R94BB1V.13172.0 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed726__0/DQN_1/events.out.tfevents.1623423607.DESKTOP-R94BB1V.16224.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D long curve open_100_6000_seed726__0/DQN_1/events.out.tfevents.1623423607.DESKTOP-R94BB1V.16224.0 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed16__0/DQN_1/events.out.tfevents.1623422879.DESKTOP-R94BB1V.7332.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed16__0/DQN_1/events.out.tfevents.1623422879.DESKTOP-R94BB1V.7332.0 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed892__0/DQN_1/events.out.tfevents.1623245191.DESKTOP-R94BB1V.7580.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-2D CURVE/DQN-2D short curve open_100_3000_seed892__0/DQN_1/events.out.tfevents.1623245191.DESKTOP-R94BB1V.7580.0 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed354__2/DQN_1/events.out.tfevents.1622849076.DESKTOP-R94BB1V.6652.2: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed354__2/DQN_1/events.out.tfevents.1622849076.DESKTOP-R94BB1V.6652.2 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed973__0/DQN_1/events.out.tfevents.1622842367.DESKTOP-R94BB1V.12936.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve open_100_9000_seed973__0/DQN_1/events.out.tfevents.1622842367.DESKTOP-R94BB1V.12936.0 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed13__4/DQN_1/events.out.tfevents.1623464885.DESKTOP-R94BB1V.9032.4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed13__4/DQN_1/events.out.tfevents.1623464885.DESKTOP-R94BB1V.9032.4 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed390__0/DQN_1/events.out.tfevents.1622760291.DESKTOP-R94BB1V.20000.3: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D long curve closed_100_12000_seed390__0/DQN_1/events.out.tfevents.1622760291.DESKTOP-R94BB1V.20000.3 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed75__0/DQN_1/events.out.tfevents.1623443774.DESKTOP-R94BB1V.5892.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed75__0/DQN_1/events.out.tfevents.1623443774.DESKTOP-R94BB1V.5892.0 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed950__4/DQN_1/events.out.tfevents.1623450140.DESKTOP-R94BB1V.10980.4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve closed_100_6000_seed950__4/DQN_1/events.out.tfevents.1623450140.DESKTOP-R94BB1V.10980.4 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed189__0/DQN_1/events.out.tfevents.1623427089.DESKTOP-R94BB1V.16192.0: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed189__0/DQN_1/events.out.tfevents.1623427089.DESKTOP-R94BB1V.16192.0 -------------------------------------------------------------------------------- /DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed309__1/DQN_1/events.out.tfevents.1623427621.DESKTOP-R94BB1V.16192.1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/b4be1/rl-for-sequential-assembly/HEAD/DQN-Experiments/DQN-3D CURVE/DQN-3D short curve open_100_3000_seed309__1/DQN_1/events.out.tfevents.1623427621.DESKTOP-R94BB1V.16192.1 -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- 1 | MIT License 2 | 3 | Copyright (c) 2021 Boris 4 | 5 | Permission is hereby granted, free of charge, to any person obtaining a copy 6 | of this software and associated documentation files (the "Software"), to deal 7 | in the Software without restriction, including without limitation the rights 8 | to use, copy, modify, merge, publish, distribute, sublicense, and/or sell 9 | copies of the Software, and to permit persons to whom the Software is 10 | furnished to do so, subject to the following conditions: 11 | 12 | The above copyright notice and this permission notice shall be included in all 13 | copies or substantial portions of the Software. 14 | 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR 16 | IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, 17 | FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE 18 | AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER 19 | LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, 20 | OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE 21 | SOFTWARE. 22 | -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- 1 | # Byte-compiled / optimized / DLL files 2 | __pycache__/ 3 | *.py[cod] 4 | *$py.class 5 | 6 | # C extensions 7 | *.so 8 | 9 | # Distribution / packaging 10 | .Python 11 | build/ 12 | develop-eggs/ 13 | dist/ 14 | downloads/ 15 | eggs/ 16 | .eggs/ 17 | lib/ 18 | lib64/ 19 | parts/ 20 | sdist/ 21 | var/ 22 | wheels/ 23 | pip-wheel-metadata/ 24 | share/python-wheels/ 25 | *.egg-info/ 26 | .installed.cfg 27 | *.egg 28 | MANIFEST 29 | 30 | # PyInstaller 31 | # Usually these files are written by a python script from a template 32 | # before PyInstaller builds the exe, so as to inject date/other infos into it. 33 | *.manifest 34 | *.spec 35 | 36 | # Installer logs 37 | pip-log.txt 38 | pip-delete-this-directory.txt 39 | 40 | # Unit test / coverage reports 41 | htmlcov/ 42 | .tox/ 43 | .nox/ 44 | .coverage 45 | .coverage.* 46 | .cache 47 | nosetests.xml 48 | coverage.xml 49 | *.cover 50 | *.py,cover 51 | .hypothesis/ 52 | .pytest_cache/ 53 | 54 | # Translations 55 | *.mo 56 | *.pot 57 | 58 | # Django stuff: 59 | *.log 60 | local_settings.py 61 | db.sqlite3 62 | db.sqlite3-journal 63 | 64 | # Flask stuff: 65 | instance/ 66 | .webassets-cache 67 | 68 | # Scrapy stuff: 69 | .scrapy 70 | 71 | # Sphinx documentation 72 | docs/_build/ 73 | 74 | # PyBuilder 75 | target/ 76 | 77 | # Jupyter Notebook 78 | .ipynb_checkpoints 79 | 80 | # IPython 81 | profile_default/ 82 | ipython_config.py 83 | 84 | # pyenv 85 | .python-version 86 | 87 | # pipenv 88 | # According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control. 89 | # However, in case of collaboration, if having platform-specific dependencies or dependencies 90 | # having no cross-platform support, pipenv may install dependencies that don't work, or not 91 | # install all needed dependencies. 92 | #Pipfile.lock 93 | 94 | # PEP 582; used by e.g. github.com/David-OConnor/pyflow 95 | __pypackages__/ 96 | 97 | # Celery stuff 98 | celerybeat-schedule 99 | celerybeat.pid 100 | 101 | # SageMath parsed files 102 | *.sage.py 103 | 104 | # Environments 105 | .env 106 | .venv 107 | env/ 108 | venv/ 109 | ENV/ 110 | env.bak/ 111 | venv.bak/ 112 | 113 | # Spyder project settings 114 | .spyderproject 115 | .spyproject 116 | 117 | # Rope project settings 118 | .ropeproject 119 | 120 | # mkdocs documentation 121 | /site 122 | 123 | # mypy 124 | .mypy_cache/ 125 | .dmypy.json 126 | dmypy.json 127 | 128 | # Pyre type checker 129 | .pyre/ 130 | 131 | # JetBrains 132 | .idea 133 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Reinforcement Learning for Sequential Assembly of SL-Blocks 2 | 3 | This repository contains Grasshopper files and Python scripts for running sequential assembly 4 | experiments from the paper "Reinforcement Learning for Sequential Assembly of SL-Blocks". 5 | Reinforcement learning library [Stable-Baselines3](https://github.com/DLR-RM/stable-baselines3) 6 | is used for training the agents, while the environments are implemented 7 | in [Grasshopper](https://www.grasshopper3d.com/) — an algorithmic modeling tool for Rhino. 8 | 9 | 10 | ## Installation 11 | 12 | Required Rhino/Grasshopper plugins can be downloaded from [Food4Rhino](https://www.food4rhino.com/) 13 | and installed as described on their respective pages 14 | 15 | * Hoopsnake 16 | * Matrixtoolbox 17 | * Pufferfish 18 | * Treesloth 19 | * Yellow 20 | * Zebra 21 | 22 | If the plugin Yellow is not available, file `yellow.gha` provided here in `Grasshopper Files` 23 | can be used as a substitute. As is common for all plugins, you may need to check the box "Unblock" 24 | in the file properties to prevent Windows from blocking it. 25 | 26 | For a general description of the interface between Grasshopper and Stable-Baselines3, 27 | see [Grasshopper Gym](https://github.com/b4be1/gh_gym). It is recommended to use 28 | [Anaconda](https://www.anaconda.com/products/individual#Downloads) to get a running Python 29 | installation under Windows. 30 | 31 | 32 | ## Training and Evaluating Agents 33 | 34 | The basic script `train-and-eval.py` provides the code for training and evaluating agents. 35 | To run the training, execute the command 36 | ``` 37 | python train-and-eval.py --algorithm="PPO" --save-path="DESIRED_PATH" 38 | ``` 39 | Here you need to specify the algorithm (either PPO or DQN) and the path where the model should be 40 | saved. Later, to evaluate the saved model, execute the command 41 | ``` 42 | python train-and-eval.py --algorithm="PPO" --load-path="DESIRED_PATH" 43 | ``` 44 | Before executing these commands, start the Hoopsnake loop inside the Grasshopper file 45 | `Reinforcement Learning Interface.gh` located in the `Grasshopper Files` directory. 46 | Parameters of the reinforcement learning algorithms can be adjusted directly 47 | in the `train-and-eval.py` script where DQN and PPO objects are created (lines 92–102). 48 | 49 | 50 | ## Experiments on 2D and 3D Curves 51 | 52 | Python scripts for training DQN and PPO agents on the 2D and 3D curves described in the paper 53 | are provided in the folder `Python Files` with the parameters are already pre-specified. 54 | Detailed instructions on how to use those scripts and how to modify the Grasshopper environment 55 | in `Reinforcement Learning Interface.gh` can be found in the accompanying video 56 | [Reinforcement Learning for Sequential Assembly of SL-Blocks in Grasshopper](https://youtu.be/owHATVWgNk4). 57 | Other algorithms used as baselines in the paper are implemented directly in Grasshopper 58 | in the file `Evolutionary Algorithm and Greedy Algorithm for SL-Blocks.gh`. 59 | Pre-trained weights for DQN and PPO agents are available in the directories 60 | `DQN-Experiments` and `PPO-Experiments`. 61 | -------------------------------------------------------------------------------- /Python Files/eval_PPO-training_for_SL-block.py: -------------------------------------------------------------------------------- 1 | import socket 2 | import struct 3 | import pickle 4 | import numpy as np 5 | import os 6 | import gym 7 | from stable_baselines3 import PPO 8 | from stable_baselines3.common.callbacks import CheckpointCallback 9 | from stable_baselines3.common.monitor import Monitor 10 | 11 | import argparse 12 | 13 | 14 | class Connection: 15 | def __init__(self, s): 16 | self._socket = s 17 | self._buffer = bytearray() 18 | 19 | def receive_object(self): 20 | while len(self._buffer) < 4 or len(self._buffer) < struct.unpack("