├── .gitignore ├── LICENSE ├── README.md ├── checkpoints └── README.md ├── configs └── vox-256-beta.yaml ├── data ├── demo_15s.mp4 ├── drive_audio.wav ├── drive_video.mp4 ├── example.png └── example.wav ├── environment.yml ├── hparams.py ├── inference.py ├── local_utils.py ├── model.py ├── modules ├── dense_motion.py ├── discriminator.py ├── generator.py ├── hopenet.py ├── keypoint_detector.py ├── model.py ├── sync_batchnorm │ ├── __init__.py │ ├── batchnorm.py │ ├── comm.py │ ├── replicate.py │ └── unittest.py ├── tencent_wav2vec.py └── util.py └── render.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/README.md -------------------------------------------------------------------------------- /checkpoints/README.md: -------------------------------------------------------------------------------- 1 | Download and put checkpoints here! 2 | 3 | 4 | 5 | -------------------------------------------------------------------------------- /configs/vox-256-beta.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/configs/vox-256-beta.yaml -------------------------------------------------------------------------------- /data/demo_15s.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/data/demo_15s.mp4 -------------------------------------------------------------------------------- /data/drive_audio.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/data/drive_audio.wav -------------------------------------------------------------------------------- /data/drive_video.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/data/drive_video.mp4 -------------------------------------------------------------------------------- /data/example.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/data/example.png -------------------------------------------------------------------------------- /data/example.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/data/example.wav -------------------------------------------------------------------------------- /environment.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/environment.yml -------------------------------------------------------------------------------- /hparams.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/hparams.py -------------------------------------------------------------------------------- /inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/inference.py -------------------------------------------------------------------------------- /local_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/local_utils.py -------------------------------------------------------------------------------- /model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/model.py -------------------------------------------------------------------------------- /modules/dense_motion.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/dense_motion.py -------------------------------------------------------------------------------- /modules/discriminator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/discriminator.py -------------------------------------------------------------------------------- /modules/generator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/generator.py -------------------------------------------------------------------------------- /modules/hopenet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/hopenet.py -------------------------------------------------------------------------------- /modules/keypoint_detector.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/keypoint_detector.py -------------------------------------------------------------------------------- /modules/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/model.py -------------------------------------------------------------------------------- /modules/sync_batchnorm/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/sync_batchnorm/__init__.py -------------------------------------------------------------------------------- /modules/sync_batchnorm/batchnorm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/sync_batchnorm/batchnorm.py -------------------------------------------------------------------------------- /modules/sync_batchnorm/comm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/sync_batchnorm/comm.py -------------------------------------------------------------------------------- /modules/sync_batchnorm/replicate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/sync_batchnorm/replicate.py -------------------------------------------------------------------------------- /modules/sync_batchnorm/unittest.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/sync_batchnorm/unittest.py -------------------------------------------------------------------------------- /modules/tencent_wav2vec.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/tencent_wav2vec.py -------------------------------------------------------------------------------- /modules/util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/modules/util.py -------------------------------------------------------------------------------- /render.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/NetEase-Media/ControlTalk/HEAD/render.py --------------------------------------------------------------------------------