├── LICENSE ├── README.md ├── create_video.sh ├── data ├── audio1_1min.wav ├── audio2_30sec.wav ├── audio3_20sec.wav └── audio4_2min.wav ├── decode_motion.py ├── encode_audio.py ├── generate.sh ├── helpers ├── DAE.py ├── alt_prosody.py ├── silence.wav ├── tools.py ├── train_DAE.py └── utils.py ├── models ├── DAE_checkpoints │ ├── checkpoint │ ├── chkpt-final.data-00000-of-00001 │ ├── chkpt-final.index │ └── chkpt-final.meta ├── Model_MFCC_Pros_Best.hdf5 ├── max_val.npy └── mean_pose.npy ├── predict.py ├── requirements.txt └── visualization ├── create_video.sh └── model_animator.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/README.md -------------------------------------------------------------------------------- /create_video.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/create_video.sh -------------------------------------------------------------------------------- /data/audio1_1min.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/data/audio1_1min.wav -------------------------------------------------------------------------------- /data/audio2_30sec.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/data/audio2_30sec.wav -------------------------------------------------------------------------------- /data/audio3_20sec.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/data/audio3_20sec.wav -------------------------------------------------------------------------------- /data/audio4_2min.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/data/audio4_2min.wav -------------------------------------------------------------------------------- /decode_motion.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/decode_motion.py -------------------------------------------------------------------------------- /encode_audio.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/encode_audio.py -------------------------------------------------------------------------------- /generate.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/generate.sh -------------------------------------------------------------------------------- /helpers/DAE.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/helpers/DAE.py -------------------------------------------------------------------------------- /helpers/alt_prosody.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/helpers/alt_prosody.py -------------------------------------------------------------------------------- /helpers/silence.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/helpers/silence.wav -------------------------------------------------------------------------------- /helpers/tools.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/helpers/tools.py -------------------------------------------------------------------------------- /helpers/train_DAE.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/helpers/train_DAE.py -------------------------------------------------------------------------------- /helpers/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/helpers/utils.py -------------------------------------------------------------------------------- /models/DAE_checkpoints/checkpoint: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/models/DAE_checkpoints/checkpoint -------------------------------------------------------------------------------- /models/DAE_checkpoints/chkpt-final.data-00000-of-00001: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/models/DAE_checkpoints/chkpt-final.data-00000-of-00001 -------------------------------------------------------------------------------- /models/DAE_checkpoints/chkpt-final.index: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/models/DAE_checkpoints/chkpt-final.index -------------------------------------------------------------------------------- /models/DAE_checkpoints/chkpt-final.meta: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/models/DAE_checkpoints/chkpt-final.meta -------------------------------------------------------------------------------- /models/Model_MFCC_Pros_Best.hdf5: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/models/Model_MFCC_Pros_Best.hdf5 -------------------------------------------------------------------------------- /models/max_val.npy: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/models/max_val.npy -------------------------------------------------------------------------------- /models/mean_pose.npy: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/models/mean_pose.npy -------------------------------------------------------------------------------- /predict.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/predict.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/requirements.txt -------------------------------------------------------------------------------- /visualization/create_video.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/visualization/create_video.sh -------------------------------------------------------------------------------- /visualization/model_animator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Svito-zar/speech-driven-hand-gesture-generation-demo/HEAD/visualization/model_animator.py --------------------------------------------------------------------------------