├── README.md ├── app.py ├── assets ├── audio_1.wav ├── audio_2.wav ├── audio_3.wav ├── audio_4.wav ├── audio_5.wav ├── driving_1.mp4 ├── driving_2.mp4 ├── driving_3.mp4 ├── driving_4.mp4 ├── source_1.png ├── source_2.png ├── source_3.jpg ├── source_4.png ├── source_5.png ├── source_6.png └── teaser.png ├── generator ├── FM.py ├── FMT.py ├── __pycache__ │ ├── FM.cpython-310.pyc │ ├── FMT.cpython-310.pyc │ └── wav2vec2.cpython-310.pyc ├── generate.py ├── options │ ├── __pycache__ │ │ └── base_options.cpython-310.pyc │ └── base_options.py └── wav2vec2.py ├── renderer ├── __pycache__ │ ├── attention_modules.cpython-310.pyc │ ├── lia_resblocks.cpython-310.pyc │ ├── models.cpython-310.pyc │ └── modules.cpython-310.pyc ├── attention_modules.py ├── inference.py ├── lia_resblocks.py ├── models.py └── modules.py └── requirement.txt /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/README.md -------------------------------------------------------------------------------- /app.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/app.py -------------------------------------------------------------------------------- /assets/audio_1.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/audio_1.wav -------------------------------------------------------------------------------- /assets/audio_2.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/audio_2.wav -------------------------------------------------------------------------------- /assets/audio_3.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/audio_3.wav -------------------------------------------------------------------------------- /assets/audio_4.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/audio_4.wav -------------------------------------------------------------------------------- /assets/audio_5.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/audio_5.wav -------------------------------------------------------------------------------- /assets/driving_1.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/driving_1.mp4 -------------------------------------------------------------------------------- /assets/driving_2.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/driving_2.mp4 -------------------------------------------------------------------------------- /assets/driving_3.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/driving_3.mp4 -------------------------------------------------------------------------------- /assets/driving_4.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/driving_4.mp4 -------------------------------------------------------------------------------- /assets/source_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/source_1.png -------------------------------------------------------------------------------- /assets/source_2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/source_2.png -------------------------------------------------------------------------------- /assets/source_3.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/source_3.jpg -------------------------------------------------------------------------------- /assets/source_4.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/source_4.png -------------------------------------------------------------------------------- /assets/source_5.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/source_5.png -------------------------------------------------------------------------------- /assets/source_6.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/source_6.png -------------------------------------------------------------------------------- /assets/teaser.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/assets/teaser.png -------------------------------------------------------------------------------- /generator/FM.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/generator/FM.py -------------------------------------------------------------------------------- /generator/FMT.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/generator/FMT.py -------------------------------------------------------------------------------- /generator/__pycache__/FM.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/generator/__pycache__/FM.cpython-310.pyc -------------------------------------------------------------------------------- /generator/__pycache__/FMT.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/generator/__pycache__/FMT.cpython-310.pyc -------------------------------------------------------------------------------- /generator/__pycache__/wav2vec2.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/generator/__pycache__/wav2vec2.cpython-310.pyc -------------------------------------------------------------------------------- /generator/generate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/generator/generate.py -------------------------------------------------------------------------------- /generator/options/__pycache__/base_options.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/generator/options/__pycache__/base_options.cpython-310.pyc -------------------------------------------------------------------------------- /generator/options/base_options.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/generator/options/base_options.py -------------------------------------------------------------------------------- /generator/wav2vec2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/generator/wav2vec2.py -------------------------------------------------------------------------------- /renderer/__pycache__/attention_modules.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/renderer/__pycache__/attention_modules.cpython-310.pyc -------------------------------------------------------------------------------- /renderer/__pycache__/lia_resblocks.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/renderer/__pycache__/lia_resblocks.cpython-310.pyc -------------------------------------------------------------------------------- /renderer/__pycache__/models.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/renderer/__pycache__/models.cpython-310.pyc -------------------------------------------------------------------------------- /renderer/__pycache__/modules.cpython-310.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/renderer/__pycache__/modules.cpython-310.pyc -------------------------------------------------------------------------------- /renderer/attention_modules.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/renderer/attention_modules.py -------------------------------------------------------------------------------- /renderer/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/renderer/inference.py -------------------------------------------------------------------------------- /renderer/lia_resblocks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/renderer/lia_resblocks.py -------------------------------------------------------------------------------- /renderer/models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/renderer/models.py -------------------------------------------------------------------------------- /renderer/modules.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/renderer/modules.py -------------------------------------------------------------------------------- /requirement.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cbsjtu01/IMTalker/HEAD/requirement.txt --------------------------------------------------------------------------------