├── AnimateZero.pdf ├── README.md └── teaser ├── images ├── 1.jpg ├── 10.jpg ├── 129.jpg ├── 141.jpg ├── 153.jpg ├── 2.jpg ├── 3.jpg ├── 4.jpg ├── 5.jpg ├── 6.jpg └── 7.jpg └── videos ├── 1.gif ├── 1.mp4 ├── 10.gif ├── 10.mp4 ├── 129.gif ├── 129.mp4 ├── 141.gif ├── 141.mp4 ├── 153.gif ├── 153.mp4 ├── 2.gif ├── 2.mp4 ├── 3.gif ├── 3.mp4 ├── 4.gif ├── 4.mp4 ├── 5.gif ├── 5.mp4 ├── 6.gif ├── 6.mp4 ├── 7.gif └── 7.mp4 /AnimateZero.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/AnimateZero.pdf -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 |
2 | 3 |

AnimateZero: Video Diffusion Models are Zero-Shot Image Animators

4 | 5 | [Jiwen Yu](https://vvictoryuki.github.io/website/)1, [Xiaodong Cun](https://vinthony.github.io/academic/)2, [Chenyang Qi](https://chenyangqiqi.github.io/)3, [Yong Zhang](https://yzhang2016.github.io/)2, [Xintao Wang](https://xinntao.github.io/)2, [Ying Shan](https://scholar.google.com/citations?hl=zh-CN&user=4oXBp9UAAAAJ)2, [Jian Zhang](https://jianzhang.tech/)1 6 | 7 | 1 Peking University, 2 Tencent AI Lab, 3 HKUST 8 | 9 | [![arXiv](https://img.shields.io/badge/arXiv--.svg)](https://arxiv.org/abs/2312.03793) 10 | [![Camera Ready Paper](https://img.shields.io/badge/Paper--red.svg)](https://github.com/vvictoryuki/AnimateZero/blob/main/AnimateZero.pdf) 11 | [![Home Page](https://img.shields.io/badge/Project_Page--blue.svg)](https://vvictoryuki.github.io/animatezero.github.io/) 12 | 13 |
14 | 15 | ## Gallery 16 | 17 | We have showcased some results of image animation using AnimateZero on generated images below. 18 | 19 | More results can be found on our [Project Page](https://vvictoryuki.github.io/animatezero.github.io/). 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 |
Image 1Animation 1Image 2Animation 1Image 3Animation 1
"1girl, underwater, swimsuit, ..."
"1girl, black jacket, long sleeves, ..."
"dark fantasy, purple eyes, ..."
Image 1Animation 1Image 2Animation 1Image 3Animation 1
"school uniform, JK, sketch, ..."
"pixel art, cat ears, blonde hair, ..."
"a cat head, look to one side"
Image 1Animation 1Image 2Animation 1Image 3Animation 1
"waves hit the beach"
"freckles, orange hair, glasses, ..."
"lighter, flame, candle"
62 | 63 | ## BibTeX 64 | ``` 65 | @article{yu2023animatezero, 66 | title={AnimateZero: Video Diffusion Models are Zero-Shot Image Animators}, 67 | author={Yu, Jiwen and Cun, Xiaodong and Qi, Chenyang and Zhang, Yong and Wang, Xintao and Shan, Ying and Zhang, Jian}, 68 | journal={arXiv preprint arXiv:2312.03793}, 69 | year={2023} 70 | } 71 | ``` 72 | -------------------------------------------------------------------------------- /teaser/images/1.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/1.jpg -------------------------------------------------------------------------------- /teaser/images/10.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/10.jpg -------------------------------------------------------------------------------- /teaser/images/129.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/129.jpg -------------------------------------------------------------------------------- /teaser/images/141.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/141.jpg -------------------------------------------------------------------------------- /teaser/images/153.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/153.jpg -------------------------------------------------------------------------------- /teaser/images/2.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/2.jpg -------------------------------------------------------------------------------- /teaser/images/3.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/3.jpg -------------------------------------------------------------------------------- /teaser/images/4.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/4.jpg -------------------------------------------------------------------------------- /teaser/images/5.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/5.jpg -------------------------------------------------------------------------------- /teaser/images/6.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/6.jpg -------------------------------------------------------------------------------- /teaser/images/7.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/images/7.jpg -------------------------------------------------------------------------------- /teaser/videos/1.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/1.gif -------------------------------------------------------------------------------- /teaser/videos/1.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/1.mp4 -------------------------------------------------------------------------------- /teaser/videos/10.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/10.gif -------------------------------------------------------------------------------- /teaser/videos/10.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/10.mp4 -------------------------------------------------------------------------------- /teaser/videos/129.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/129.gif -------------------------------------------------------------------------------- /teaser/videos/129.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/129.mp4 -------------------------------------------------------------------------------- /teaser/videos/141.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/141.gif -------------------------------------------------------------------------------- /teaser/videos/141.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/141.mp4 -------------------------------------------------------------------------------- /teaser/videos/153.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/153.gif -------------------------------------------------------------------------------- /teaser/videos/153.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/153.mp4 -------------------------------------------------------------------------------- /teaser/videos/2.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/2.gif -------------------------------------------------------------------------------- /teaser/videos/2.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/2.mp4 -------------------------------------------------------------------------------- /teaser/videos/3.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/3.gif -------------------------------------------------------------------------------- /teaser/videos/3.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/3.mp4 -------------------------------------------------------------------------------- /teaser/videos/4.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/4.gif -------------------------------------------------------------------------------- /teaser/videos/4.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/4.mp4 -------------------------------------------------------------------------------- /teaser/videos/5.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/5.gif -------------------------------------------------------------------------------- /teaser/videos/5.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/5.mp4 -------------------------------------------------------------------------------- /teaser/videos/6.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/6.gif -------------------------------------------------------------------------------- /teaser/videos/6.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/6.mp4 -------------------------------------------------------------------------------- /teaser/videos/7.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/7.gif -------------------------------------------------------------------------------- /teaser/videos/7.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yujiwen/AnimateZero/936e94f33d431771aaf1d786ce83ee963fbf0f6c/teaser/videos/7.mp4 --------------------------------------------------------------------------------