├── README.md ├── version1.0 demo.png └── webcam_smoothed_real_time.png /README.md: -------------------------------------------------------------------------------- 1 | # real-time-3d-pose-estimation-with-Unity3D-public 2 | 3 | 4 | ### Video demo: https://www.youtube.com/watch?v=JnFtVC0ou6I&t=2s 5 | 6 | 7 | 8 | 9 | ### Webcam demo: https://www.youtube.com/watch?v=WJVNDUkx74s&feature=youtu.be or https://www.bilibili.com/video/av69684062 10 | 11 | 12 | 13 | 14 | 15 | ## How do I make it: 16 | 1. I use the run.py code from this link to generate 3d coordinates of body parts in real-time. Then did some data transformation. https://qiita.com/keel/items/0d64167850566586d22a. To run this code, some configuration should be done: https://github.com/ildoonet/tf-pose-estimation 17 | 2. Modified above code to be able to send 3d coordinates to Unity3D using "socket" package in python and C#. 18 | 3. Create an Unity App based on https://github.com/keel-210/OpenPose-Rig. 19 | 4. I learn from this code to make character move. https://qiita.com/kenkra/items/7b5634ff7f8c6bf0257a. Note: you have to attach this code to your character. 20 | 21 | 22 | 23 | ## Other useful links: 24 | ### https://qiita.com/romaroma/items/ffbdae4ecfc4c8ff31cd 25 | ### https://github.com/zhenyuczy/openpose_3d-pose-baseline_unity3d 26 | ### https://github.com/ArashHosseini/3d-pose-baseline 27 | 28 | 29 | 30 | 31 | 32 | -------------------------------------------------------------------------------- /version1.0 demo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jacob12138xieyuan/real-time-3d-pose-estimation-with-Unity3D-public/f48aa10f45255727e60d88c61beac3675c19f283/version1.0 demo.png -------------------------------------------------------------------------------- /webcam_smoothed_real_time.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Jacob12138xieyuan/real-time-3d-pose-estimation-with-Unity3D-public/f48aa10f45255727e60d88c61beac3675c19f283/webcam_smoothed_real_time.png --------------------------------------------------------------------------------