├── README.md ├── arguments.py ├── asset └── teaser.png ├── data ├── AVE │ ├── test.csv │ ├── testsepave.csv │ ├── train.csv │ └── val.csv └── Music │ ├── test.csv │ ├── testsepmusic.csv │ ├── train.csv │ └── val.csv ├── dataset ├── __init__.py ├── ave.py ├── base.py ├── music.py └── video_transforms.py ├── diffusion_utils └── diffusion_pytorch.py ├── main.py ├── main_ave.py ├── main_ave_fm.py ├── main_fm.py ├── modules ├── audioVisual_model.py ├── models.py ├── networks.py └── unet.py ├── preprocessing ├── extract_audio.py └── extract_frames.py ├── requirements.txt ├── scripts ├── run.sh ├── run_ave.sh ├── run_ave_fm.sh └── run_fm.sh └── utils.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/README.md -------------------------------------------------------------------------------- /arguments.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/arguments.py -------------------------------------------------------------------------------- /asset/teaser.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/asset/teaser.png -------------------------------------------------------------------------------- /data/AVE/test.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/data/AVE/test.csv -------------------------------------------------------------------------------- /data/AVE/testsepave.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/data/AVE/testsepave.csv -------------------------------------------------------------------------------- /data/AVE/train.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/data/AVE/train.csv -------------------------------------------------------------------------------- /data/AVE/val.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/data/AVE/val.csv -------------------------------------------------------------------------------- /data/Music/test.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/data/Music/test.csv -------------------------------------------------------------------------------- /data/Music/testsepmusic.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/data/Music/testsepmusic.csv -------------------------------------------------------------------------------- /data/Music/train.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/data/Music/train.csv -------------------------------------------------------------------------------- /data/Music/val.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/data/Music/val.csv -------------------------------------------------------------------------------- /dataset/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/dataset/__init__.py -------------------------------------------------------------------------------- /dataset/ave.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/dataset/ave.py -------------------------------------------------------------------------------- /dataset/base.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/dataset/base.py -------------------------------------------------------------------------------- /dataset/music.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/dataset/music.py -------------------------------------------------------------------------------- /dataset/video_transforms.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/dataset/video_transforms.py -------------------------------------------------------------------------------- /diffusion_utils/diffusion_pytorch.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/diffusion_utils/diffusion_pytorch.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/main.py -------------------------------------------------------------------------------- /main_ave.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/main_ave.py -------------------------------------------------------------------------------- /main_ave_fm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/main_ave_fm.py -------------------------------------------------------------------------------- /main_fm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/main_fm.py -------------------------------------------------------------------------------- /modules/audioVisual_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/modules/audioVisual_model.py -------------------------------------------------------------------------------- /modules/models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/modules/models.py -------------------------------------------------------------------------------- /modules/networks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/modules/networks.py -------------------------------------------------------------------------------- /modules/unet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/modules/unet.py -------------------------------------------------------------------------------- /preprocessing/extract_audio.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/preprocessing/extract_audio.py -------------------------------------------------------------------------------- /preprocessing/extract_frames.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/preprocessing/extract_frames.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/requirements.txt -------------------------------------------------------------------------------- /scripts/run.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/scripts/run.sh -------------------------------------------------------------------------------- /scripts/run_ave.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/scripts/run_ave.sh -------------------------------------------------------------------------------- /scripts/run_ave_fm.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/scripts/run_ave_fm.sh -------------------------------------------------------------------------------- /scripts/run_fm.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/scripts/run_fm.sh -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/WikiChao/DAVIS/HEAD/utils.py --------------------------------------------------------------------------------