├── .gitignore ├── README.md ├── app.py ├── checkpoints ├── generator │ └── README.md ├── image2image │ └── README.md └── syncnet │ └── README.md ├── dummy ├── README.md ├── face.gif ├── landmark.gif ├── me.png └── test_audio.mp3 ├── env.yml ├── evaluation ├── README.md ├── calc_flop.py ├── eval_vdo │ └── README.md ├── gen_eval_vdo.py └── temp │ └── README.md ├── filelists └── README.md ├── hparams.py ├── logs ├── generator │ └── README.md └── syncnet │ └── README.md ├── preprocess_data.py ├── requirements.txt ├── run_inference.py ├── run_train_generator.py ├── run_train_syncnet.py ├── src ├── __init__.py ├── dataset │ ├── generator.py │ └── syncnet.py ├── main │ ├── generator.py │ ├── inference.py │ └── syncnet.py └── models │ ├── __init__.py │ ├── attnlstm.py │ ├── image2image.py │ ├── lstmgen.py │ └── syncnet.py ├── temp └── README.md └── utils ├── audio.py ├── loss.py ├── plot.py ├── utils.py └── wav2lip.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/README.md -------------------------------------------------------------------------------- /app.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/app.py -------------------------------------------------------------------------------- /checkpoints/generator/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/checkpoints/generator/README.md -------------------------------------------------------------------------------- /checkpoints/image2image/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/checkpoints/image2image/README.md -------------------------------------------------------------------------------- /checkpoints/syncnet/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/checkpoints/syncnet/README.md -------------------------------------------------------------------------------- /dummy/README.md: -------------------------------------------------------------------------------- 1 | put dummy input file here 2 | -------------------------------------------------------------------------------- /dummy/face.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/dummy/face.gif -------------------------------------------------------------------------------- /dummy/landmark.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/dummy/landmark.gif -------------------------------------------------------------------------------- /dummy/me.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/dummy/me.png -------------------------------------------------------------------------------- /dummy/test_audio.mp3: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/dummy/test_audio.mp3 -------------------------------------------------------------------------------- /env.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/env.yml -------------------------------------------------------------------------------- /evaluation/README.md: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /evaluation/calc_flop.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/evaluation/calc_flop.py -------------------------------------------------------------------------------- /evaluation/eval_vdo/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/evaluation/eval_vdo/README.md -------------------------------------------------------------------------------- /evaluation/gen_eval_vdo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/evaluation/gen_eval_vdo.py -------------------------------------------------------------------------------- /evaluation/temp/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/evaluation/temp/README.md -------------------------------------------------------------------------------- /filelists/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/filelists/README.md -------------------------------------------------------------------------------- /hparams.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/hparams.py -------------------------------------------------------------------------------- /logs/generator/README.md: -------------------------------------------------------------------------------- 1 | This folder shall contain log for generator 2 | -------------------------------------------------------------------------------- /logs/syncnet/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/logs/syncnet/README.md -------------------------------------------------------------------------------- /preprocess_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/preprocess_data.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/requirements.txt -------------------------------------------------------------------------------- /run_inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/run_inference.py -------------------------------------------------------------------------------- /run_train_generator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/run_train_generator.py -------------------------------------------------------------------------------- /run_train_syncnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/run_train_syncnet.py -------------------------------------------------------------------------------- /src/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/src/__init__.py -------------------------------------------------------------------------------- /src/dataset/generator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/src/dataset/generator.py -------------------------------------------------------------------------------- /src/dataset/syncnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/src/dataset/syncnet.py -------------------------------------------------------------------------------- /src/main/generator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/src/main/generator.py -------------------------------------------------------------------------------- /src/main/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/src/main/inference.py -------------------------------------------------------------------------------- /src/main/syncnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/src/main/syncnet.py -------------------------------------------------------------------------------- /src/models/__init__.py: -------------------------------------------------------------------------------- 1 | # 2 | -------------------------------------------------------------------------------- /src/models/attnlstm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/src/models/attnlstm.py -------------------------------------------------------------------------------- /src/models/image2image.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/src/models/image2image.py -------------------------------------------------------------------------------- /src/models/lstmgen.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/src/models/lstmgen.py -------------------------------------------------------------------------------- /src/models/syncnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/src/models/syncnet.py -------------------------------------------------------------------------------- /temp/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/temp/README.md -------------------------------------------------------------------------------- /utils/audio.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/utils/audio.py -------------------------------------------------------------------------------- /utils/loss.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/utils/loss.py -------------------------------------------------------------------------------- /utils/plot.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/utils/plot.py -------------------------------------------------------------------------------- /utils/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/utils/utils.py -------------------------------------------------------------------------------- /utils/wav2lip.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterwisu/lip-synthesis/HEAD/utils/wav2lip.py --------------------------------------------------------------------------------