├── .gitignore ├── CITATION.cff ├── LICENSE ├── README.md ├── asset ├── flame │ ├── head_template_mesh.obj │ ├── landmark_embedding_with_eyes.npy │ ├── tex_mean_painted.png │ └── uv_masks.npz ├── flame_editor.png ├── flame_viewer.png ├── monocular.jpg ├── monocular_obama.gif ├── monocular_obama.mp4 ├── monocular_person_0004.gif ├── monocular_person_0004.mp4 ├── nersemble.jpg ├── nersemble_038_EMO-1.gif ├── nersemble_038_EMO-1.mp4 ├── nersemble_074_EMO-1.gif ├── nersemble_074_EMO-1.mp4 └── teaser.gif ├── doc ├── monocular.md ├── nersemble.md └── nersemble_v2.md ├── jobs ├── combine_nersemble.sh ├── run_monocular.sh └── run_nersemble.sh ├── pyproject.toml └── vhap ├── combine_nerf_datasets.py ├── config ├── base.py ├── nersemble.py └── nersemble_v2.py ├── data ├── image_folder_dataset.py ├── nerf_dataset.py ├── nersemble_dataset.py ├── nersemble_v2_dataset.py └── video_dataset.py ├── export_as_nerf_dataset.py ├── flame_editor.py ├── flame_viewer.py ├── generate_flame_uvmask.py ├── model ├── flame.py ├── lbs.py └── tracker.py ├── preprocess_video.py ├── track.py ├── track_nersemble.py ├── track_nersemble_v2.py └── util ├── camera.py ├── color_correction.py ├── landmark_detector_fa.py ├── landmark_detector_star.py ├── log.py ├── mesh.py ├── render_nvdiffrast.py ├── render_uvmap.py ├── vector_ops.py └── visualization.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/.gitignore -------------------------------------------------------------------------------- /CITATION.cff: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/CITATION.cff -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/README.md -------------------------------------------------------------------------------- /asset/flame/head_template_mesh.obj: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/flame/head_template_mesh.obj -------------------------------------------------------------------------------- /asset/flame/landmark_embedding_with_eyes.npy: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/flame/landmark_embedding_with_eyes.npy -------------------------------------------------------------------------------- /asset/flame/tex_mean_painted.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/flame/tex_mean_painted.png -------------------------------------------------------------------------------- /asset/flame/uv_masks.npz: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/flame/uv_masks.npz -------------------------------------------------------------------------------- /asset/flame_editor.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/flame_editor.png -------------------------------------------------------------------------------- /asset/flame_viewer.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/flame_viewer.png -------------------------------------------------------------------------------- /asset/monocular.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/monocular.jpg -------------------------------------------------------------------------------- /asset/monocular_obama.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/monocular_obama.gif -------------------------------------------------------------------------------- /asset/monocular_obama.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/monocular_obama.mp4 -------------------------------------------------------------------------------- /asset/monocular_person_0004.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/monocular_person_0004.gif -------------------------------------------------------------------------------- /asset/monocular_person_0004.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/monocular_person_0004.mp4 -------------------------------------------------------------------------------- /asset/nersemble.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/nersemble.jpg -------------------------------------------------------------------------------- /asset/nersemble_038_EMO-1.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/nersemble_038_EMO-1.gif -------------------------------------------------------------------------------- /asset/nersemble_038_EMO-1.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/nersemble_038_EMO-1.mp4 -------------------------------------------------------------------------------- /asset/nersemble_074_EMO-1.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/nersemble_074_EMO-1.gif -------------------------------------------------------------------------------- /asset/nersemble_074_EMO-1.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/nersemble_074_EMO-1.mp4 -------------------------------------------------------------------------------- /asset/teaser.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/asset/teaser.gif -------------------------------------------------------------------------------- /doc/monocular.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/doc/monocular.md -------------------------------------------------------------------------------- /doc/nersemble.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/doc/nersemble.md -------------------------------------------------------------------------------- /doc/nersemble_v2.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/doc/nersemble_v2.md -------------------------------------------------------------------------------- /jobs/combine_nersemble.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/jobs/combine_nersemble.sh -------------------------------------------------------------------------------- /jobs/run_monocular.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/jobs/run_monocular.sh -------------------------------------------------------------------------------- /jobs/run_nersemble.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/jobs/run_nersemble.sh -------------------------------------------------------------------------------- /pyproject.toml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/pyproject.toml -------------------------------------------------------------------------------- /vhap/combine_nerf_datasets.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/combine_nerf_datasets.py -------------------------------------------------------------------------------- /vhap/config/base.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/config/base.py -------------------------------------------------------------------------------- /vhap/config/nersemble.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/config/nersemble.py -------------------------------------------------------------------------------- /vhap/config/nersemble_v2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/config/nersemble_v2.py -------------------------------------------------------------------------------- /vhap/data/image_folder_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/data/image_folder_dataset.py -------------------------------------------------------------------------------- /vhap/data/nerf_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/data/nerf_dataset.py -------------------------------------------------------------------------------- /vhap/data/nersemble_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/data/nersemble_dataset.py -------------------------------------------------------------------------------- /vhap/data/nersemble_v2_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/data/nersemble_v2_dataset.py -------------------------------------------------------------------------------- /vhap/data/video_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/data/video_dataset.py -------------------------------------------------------------------------------- /vhap/export_as_nerf_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/export_as_nerf_dataset.py -------------------------------------------------------------------------------- /vhap/flame_editor.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/flame_editor.py -------------------------------------------------------------------------------- /vhap/flame_viewer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/flame_viewer.py -------------------------------------------------------------------------------- /vhap/generate_flame_uvmask.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/generate_flame_uvmask.py -------------------------------------------------------------------------------- /vhap/model/flame.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/model/flame.py -------------------------------------------------------------------------------- /vhap/model/lbs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/model/lbs.py -------------------------------------------------------------------------------- /vhap/model/tracker.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/model/tracker.py -------------------------------------------------------------------------------- /vhap/preprocess_video.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/preprocess_video.py -------------------------------------------------------------------------------- /vhap/track.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/track.py -------------------------------------------------------------------------------- /vhap/track_nersemble.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/track_nersemble.py -------------------------------------------------------------------------------- /vhap/track_nersemble_v2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/track_nersemble_v2.py -------------------------------------------------------------------------------- /vhap/util/camera.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/util/camera.py -------------------------------------------------------------------------------- /vhap/util/color_correction.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/util/color_correction.py -------------------------------------------------------------------------------- /vhap/util/landmark_detector_fa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/util/landmark_detector_fa.py -------------------------------------------------------------------------------- /vhap/util/landmark_detector_star.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/util/landmark_detector_star.py -------------------------------------------------------------------------------- /vhap/util/log.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/util/log.py -------------------------------------------------------------------------------- /vhap/util/mesh.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/util/mesh.py -------------------------------------------------------------------------------- /vhap/util/render_nvdiffrast.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/util/render_nvdiffrast.py -------------------------------------------------------------------------------- /vhap/util/render_uvmap.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/util/render_uvmap.py -------------------------------------------------------------------------------- /vhap/util/vector_ops.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/util/vector_ops.py -------------------------------------------------------------------------------- /vhap/util/visualization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ShenhanQian/VHAP/HEAD/vhap/util/visualization.py --------------------------------------------------------------------------------