├── .gitignore ├── Lesson_1.md ├── Lesson_2.md ├── README.md ├── assets └── data_aug.mov ├── notebooks ├── gemini_spatial_3D.ipynb ├── inference.ipynb ├── pi0_flow_matching.ipynb └── scripts │ ├── control_utils.py │ ├── gemini_perception.py │ ├── record_bbox.py │ ├── record_bbox_multi.py │ └── timestep_norm │ ├── compute_enhanced_stats.py │ ├── normalize_tedrake.py │ └── train_with_tedrake.py ├── self_debugging_robot ├── .gitignore ├── 00_gemini_loop.ipynb ├── 01_augment_dataset.ipynb ├── README.md ├── __init__.py ├── record_kinesics.ipynb ├── sample_images │ ├── annotated_robot.jpg │ ├── front_view.jpeg │ ├── side_view.jpeg │ └── top_view.jpeg └── scripts │ ├── aug_utils.py │ ├── gemini_utils.py │ ├── image_utils.py │ ├── inpaint_utils.py │ └── robocontrol.py └── timestep_norm.md /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/.gitignore -------------------------------------------------------------------------------- /Lesson_1.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/Lesson_1.md -------------------------------------------------------------------------------- /Lesson_2.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/Lesson_2.md -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/README.md -------------------------------------------------------------------------------- /assets/data_aug.mov: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/assets/data_aug.mov -------------------------------------------------------------------------------- /notebooks/gemini_spatial_3D.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/notebooks/gemini_spatial_3D.ipynb -------------------------------------------------------------------------------- /notebooks/inference.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/notebooks/inference.ipynb -------------------------------------------------------------------------------- /notebooks/pi0_flow_matching.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/notebooks/pi0_flow_matching.ipynb -------------------------------------------------------------------------------- /notebooks/scripts/control_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/notebooks/scripts/control_utils.py -------------------------------------------------------------------------------- /notebooks/scripts/gemini_perception.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/notebooks/scripts/gemini_perception.py -------------------------------------------------------------------------------- /notebooks/scripts/record_bbox.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/notebooks/scripts/record_bbox.py -------------------------------------------------------------------------------- /notebooks/scripts/record_bbox_multi.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/notebooks/scripts/record_bbox_multi.py -------------------------------------------------------------------------------- /notebooks/scripts/timestep_norm/compute_enhanced_stats.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/notebooks/scripts/timestep_norm/compute_enhanced_stats.py -------------------------------------------------------------------------------- /notebooks/scripts/timestep_norm/normalize_tedrake.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/notebooks/scripts/timestep_norm/normalize_tedrake.py -------------------------------------------------------------------------------- /notebooks/scripts/timestep_norm/train_with_tedrake.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/notebooks/scripts/timestep_norm/train_with_tedrake.py -------------------------------------------------------------------------------- /self_debugging_robot/.gitignore: -------------------------------------------------------------------------------- 1 | .DS_Store -------------------------------------------------------------------------------- /self_debugging_robot/00_gemini_loop.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/00_gemini_loop.ipynb -------------------------------------------------------------------------------- /self_debugging_robot/01_augment_dataset.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/01_augment_dataset.ipynb -------------------------------------------------------------------------------- /self_debugging_robot/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/README.md -------------------------------------------------------------------------------- /self_debugging_robot/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /self_debugging_robot/record_kinesics.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/record_kinesics.ipynb -------------------------------------------------------------------------------- /self_debugging_robot/sample_images/annotated_robot.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/sample_images/annotated_robot.jpg -------------------------------------------------------------------------------- /self_debugging_robot/sample_images/front_view.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/sample_images/front_view.jpeg -------------------------------------------------------------------------------- /self_debugging_robot/sample_images/side_view.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/sample_images/side_view.jpeg -------------------------------------------------------------------------------- /self_debugging_robot/sample_images/top_view.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/sample_images/top_view.jpeg -------------------------------------------------------------------------------- /self_debugging_robot/scripts/aug_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/scripts/aug_utils.py -------------------------------------------------------------------------------- /self_debugging_robot/scripts/gemini_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/scripts/gemini_utils.py -------------------------------------------------------------------------------- /self_debugging_robot/scripts/image_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/scripts/image_utils.py -------------------------------------------------------------------------------- /self_debugging_robot/scripts/inpaint_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/scripts/inpaint_utils.py -------------------------------------------------------------------------------- /self_debugging_robot/scripts/robocontrol.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/self_debugging_robot/scripts/robocontrol.py -------------------------------------------------------------------------------- /timestep_norm.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/tuul-ai/robotbuilder/HEAD/timestep_norm.md --------------------------------------------------------------------------------