└── README.md /README.md: -------------------------------------------------------------------------------- 1 | # TalkingEyes: Pluralistic Speech-Driven 3D Eye Gaze Animation 2 | 3 | ## Talking Eyes Dataset (TKED) 4 | TKED consists of 5,982 videos featuring 669 subjects, amounting to approximately 14 hours of footage in total. Out of the 5,982 videos, 5,912 are from [VoxCeleb2](https://mm.kaist.ac.kr/datasets/voxceleb/), with a total duration of about 12 hours, while the remaining 70 videos are from [HDTF](https://github.com/MRzzm/HDTF), totaling about 2 hours. 5 | 6 | We have conducted 3D face reconstruction and 3D eye gaze fitting on each frame of these videos to obtain the pseudo ground truth [FLAME](https://flame.is.tue.mpg.de/) parameters, which include **two eyeballs' rotation, head rotation and facial motion parameters**. 7 | 8 | Along with the audio stored in the original videos, **TKED is first dataset in the research community to simultaneously contain the three types of resources: 3D talking eyes, 3D talking head and 3D talking faces**. 9 | 10 | - Download TKED from [Google Drive](https://drive.google.com/file/d/1rSvAx2oo8e1hY9xz5uCxnLngPcINftzZ/view?usp=sharing). 11 | - Download TKED from [Baidu Netdisk](https://pan.baidu.com/s/1Y5-xtmwBYHdYZLDNBlQzWA?pwd=TKED) (code: TKED). 12 | --------------------------------------------------------------------------------