├── LICENSE └── README.md /LICENSE: -------------------------------------------------------------------------------- 1 | MIT License 2 | 3 | Copyright (c) 2019 Tzu-Heng Lin 4 | 5 | Permission is hereby granted, free of charge, to any person obtaining a copy 6 | of this software and associated documentation files (the "Software"), to deal 7 | in the Software without restriction, including without limitation the rights 8 | to use, copy, modify, merge, publish, distribute, sublicense, and/or sell 9 | copies of the Software, and to permit persons to whom the Software is 10 | furnished to do so, subject to the following conditions: 11 | 12 | The above copyright notice and this permission notice shall be included in all 13 | copies or substantial portions of the Software. 14 | 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR 16 | IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, 17 | FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE 18 | AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER 19 | LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, 20 | OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE 21 | SOFTWARE. 22 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Guided Image-to-Image Translation papers 2 | 3 | **Feel free to send a PR or issue. (constantly updating)** 4 | 5 | - [Class Label Guided](#Class-Label-Guided) 6 | - [Action Unit Guided](#Action-Unit-Guided) 7 | - [Facial Landmark Guided](#Facial-Landmark-Guided) 8 | - [Pose Guided Person Image Generation](#Pose-Guided-Person-Image-Generation) 9 | - [Segmentation Map Guided Scene Image Generation](#Segmentation-Map-Guided-Scene-Image-Generation) 10 | - [Texture Patch Guided](#Texture-Patch-Guided) 11 | - [Example Guided](#Example-Guided) 12 | - [Attention Guided](#Attention-Guided) 13 | - [Mask Guided](#Mask-Guided) 14 | - [Text Guided](#Text-Guided) 15 | - [Audio Guided](#Audio-Guided) 16 | 17 | 18 | ## Class Label Guided 19 | Model | Paper | Conference | Arxiv | Code | 20 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 21 | IcGAN | Invertible Conditional GANs for image editing | NeurIPSW 2016 | [1611.06355](https://arxiv.org/abs/1611.06355) | [Guim3/IcGAN](https://github.com/Guim3/IcGAN) | 22 | Conditional CycleGAN | Conditional CycleGAN for Attribute Guided Face Image Generation | ECCV 2018 | [1705.09966](https://arxiv.org/abs/1705.09966) | | 23 | StarGAN | StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation | CVPR 2018 | [1711.09020](https://arxiv.org/abs/1711.09020) | [yunjey/StarGAN](https://github.com/yunjey/StarGAN) | 24 | AGUIT | Attribute Guided Unpaired Image-to-Image Translation with Semi-supervised Learning | | [1904.12428](https://arxiv.org/abs/1904.12428) | [imlixinyang/AGUIT](https://github.com/imlixinyang/AGUIT) | 25 | AttGAN | AttGAN: Facial Attribute Editing by Only Changing What You Want | TIP 2019 | [1711.10678](https://arxiv.org/abs/1711.10678) | [LynnHo/AttGAN-Tensorflow](https://github.com/LynnHo/AttGAN-Tensorflow) | 26 | SGGAN | Sparsely Grouped Multi-task Generative Adversarial Networks for Facial Attribute Manipulation | MM 2018 | [1805.07509](https://arxiv.org/abs/1805.07509) | [zhangqianhui/Sparsely-Grouped-GAN](https://github.com/zhangqianhui/Sparsely-Grouped-GAN) | 27 | RelGAN | RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributes | ICCV 2019 | [1908.07269](https://arxiv.org/abs/1908.07269) | [elvisyjlin/RelGAN-PyTorch](https://github.com/elvisyjlin/RelGAN-PyTorch), [willylulu/RelGAN](https://github.com/willylulu/RelGAN) | 28 | 29 | ## Action Unit Guided 30 | Model | Paper | Conference | Arxiv | Code | 31 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 32 | GANimation | GANimation: Anatomically-aware Facial Animation from a Single Image | ECCV 2018 | [1807.09251](https://arxiv.org/abs/1807.09251) | [albertpumarola/GANimation](https://github.com/albertpumarola/GANimation) | 33 | 34 | ## Facial Landmark Guided 35 | Model | Paper | Conference | Arxiv | Code | 36 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 37 | G2GAN | Geometry Guided Adversarial Facial Expression Synthesis | MM 2018 | [1712.03474](https://arxiv.org/abs/1712.03474) | 38 | CMM-Net | Every Smile is Unique: Landmark-Guided Diverse Smile Generation | CVPR 2018 | [1802.01873](https://arxiv.org/abs/1802.01873) | | 39 | C2GAN | Cycle In Cycle Generative Adversarial Networks for Keypoint-Guided Image Generation | MM 2019 | [1908.00999](https://arxiv.org/abs/1908.00999) | [Ha0Tang/C2GAN](https://github.com/Ha0Tang/C2GAN) | 40 | | | Few-Shot Adversarial Learning of Realistic Neural Talking Head Models | ICCV 2019 | [1905.08233](https://arxiv.org/abs/1905.08233) | [grey-eye/talking-heads](https://github.com/grey-eye/talking-heads) | 41 | 42 | ## Pose Guided Person Image Generation 43 | Model | Paper | Conference | Arxiv | Code | 44 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 45 | PG2 | Pose Guided Person Image Generation | NeurIPS 2017 | [1705.09368](https://arxiv.org/abs/1705.09368) | [charliememory/Pose-Guided-Person-Image-Generation](https://github.com/charliememory/Pose-Guided-Person-Image-Generation) 46 | PoseGAN | Deformable GANs for Pose-Based Human Image Generation | CVPR 2018 | [1801.00055](https://arxiv.org/abs/1801.00055) | [AliaksandrSiarohin/pose-gan](https://github.com/AliaksandrSiarohin/pose-gan) 47 | VUnet | A Variational U-Net for Conditional Appearance and Shape Generation | CVPR 2018 | [1804.04694](https://arxiv.org/abs/1804.04694) | [CompVis/vunet](https://github.com/CompVis/vunet) 48 | PoseWarp | Synthesizing Images of Humans in Unseen Poses | CVPR 2018 | [1804.07739](https://arxiv.org/abs/1804.07739) | [posewarp-cvpr2018](https://github.com/balakg/posewarp-cvpr2018) | 49 | DPIG | Disentangled Person Image Generation | CVPR 2018 | [1712.02621](https://arxiv.org/abs/1712.02621) | [charliememory/Disentangled-Person-Image-Generation](https://github.com/charliememory/Disentangled-Person-Image-Generation) | 50 | FD-GAN | FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification | NeurIPS 2018 | [1810.02936](https://arxiv.org/abs/1810.02936) | [yxgeee/FD-GAN](https://github.com/yxgeee/FD-GAN) | 51 | PN-GAN | Pose-Normalized Image Generation for Person Re-identification | ECCV 2018 | [1712.02225](https://arxiv.org/abs/1712.02225) | [naiq/PN_GAN](https://github.com/naiq/PN_GAN) | 52 | GestureGAN | GestureGAN for Hand Gesture-to-Gesture Translation in the Wild | MM 2018 | [1808.04859](https://arxiv.org/abs/1808.04859) | [Ha0Tang/GestureGAN](https://github.com/Ha0Tang/GestureGAN) | 53 | PATN | Progressive Pose Attention for Person Image Generation | CVPR 2019 | [1904.03349](https://arxiv.org/abs/1904.03349) | [tengteng95/Pose-Transfer](https://github.com/tengteng95/Pose-Transfer) | 54 | SPT | Unsupervised Person Image Generation with Semantic Parsing Transformation | CVPR 2019 | [1904.03379](https://arxiv.org/abs/1904.03379) | [SijieSong/person_generation_spt](https://github.com/SijieSong/person_generation_spt) | 55 | | | Coordinate-based Texture Inpainting for Pose-Guided Human Image Generation | CVPR 2019 | [1811.11459](https://arxiv.org/abs/1811.11459) | [project](https://saic-violet.github.io/coordinpaint/) | 56 | IntrinsicFlow | Dense intrinsic appearance flow for human pose transfer | CVPR 2019 | [1903.11326](https://arxiv.org/abs/1903.11326) | [ly015/intrinsic_flow](https://github.com/ly015/intrinsic_flow) | 57 | TriangleGAN | Gesture-to-Gesture Translation in the Wild via Category-Independent Conditional Maps | MM 2019 | [1907.05916](https://arxiv.org/abs/1907.05916) | [yhlleo/TriangleGAN](https://github.com/yhlleo/TriangleGAN) | 58 | Pix2pixHD + Temporal Smoothing + FaceGAN | Everybody Dance Now | ICCV 2019 | [1808.07371](https://arxiv.org/abs/1808.07371) | [project](https://carolineec.github.io/everybody_dance_now/) | 59 | LiquidWarpingGAN | Liquid warping gan: A unified framework for human motion imitation, appearance transfer and novel view synthesis | ICCV 2019 | [1909.12224](https://arxiv.org/abs/1909.12224) | [svip-lab/impersonator](https://github.com/svip-lab/impersonator) | 60 | Global-Flow-Local-Attention | Deep Image Spatial Transformation for Person Image Generation | CVPR 2020 | [2003.00696](https://arxiv.org/abs/2003.00696) | [RenYurui/Global-Flow-Local-Attention](https://github.com/RenYurui/Global-Flow-Local-Attention) | 61 | ADGAN | Controllable Person Image Synthesis With Attribute-Decomposed GAN | CVPR 2020 | [2003.12267](https://arxiv.org/abs/2003.12267) | [menyifang/ADGAN](https://github.com/menyifang/ADGAN) | 62 | CoCosNet | Cross-domain Correspondence Learning for Exemplar-based Image Translation | CVPR 2020 | [2004.05571](https://arxiv.org/abs/2004.05571) | [microsoft/CoCosNet](https://github.com/microsoft/CoCosNet) | 63 | SMIS | Semantically Multi-modal Image Synthesis | CVPR 2020 | [2003.12697](https://arxiv.org/abs/2003.12697) | [Seanseattle/SMIS](https://github.com/Seanseattle/SMIS) | 64 | MISC | MISC: Multi-Condition Injection and Spatially-Adaptive Compositing for Conditional Person Image Synthesis | CVPR 2020 | [cvpr20](https://openaccess.thecvf.com/content_CVPR_2020/html/Weng_MISC_Multi-Condition_Injection_and_Spatially-Adaptive_Compositing_for_Conditional_Person_Image_CVPR_2020_paper.html) | | 65 | Warp3d_Reposing | Reposing Humans by Warping 3D Features | CVPR 2020 Workshop | [2006.04898](https://arxiv.org/abs/2006.04898) | [MKnoche/warp3d_reposing](https://github.com/MKnoche/warp3d_reposing) | 66 | | | Wish You Were Here: Context-Aware Human Generation | CVPR 2020 | [2005.10663](https://arxiv.org/abs/2005.10663) | | 67 | PoseStylizer | Generating Person Images with Appearance-aware Pose Stylizer | IJCAI 2020 | [2007.09077](https://arxiv.org/abs/2007.09077) | [siyuhuang/PoseStylizer](https://github.com/siyuhuang/PoseStylizer) | 68 | XingGAN | XingGAN for Person Image Generation | ECCV 2020 | [2007.09278](https://arxiv.org/abs/2007.09278) | [Ha0Tang/XingGAN](https://github.com/Ha0Tang/XingGAN) | 69 | 70 | 71 | ## Segmentation Map Guided Scene Image Generation 72 | Model | Paper | Conference | Arxiv | Code | 73 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 74 | CRN | Photographic Image Synthesis with Cascaded Refinement Networks | ICCV 2017 | [1707.09405](https://arxiv.org/abs/1707.09405) | [CQFIO/PhotographicImageSynthesis](https://github.com/CQFIO/PhotographicImageSynthesis) | 75 | CrossNet | Predicting Ground-Level Scene Layout from Aerial Imagery | CVPR 2017 | [1612.02709](https://arxiv.org/abs/1612.02709) | [viibridges/crossnet](https://github.com/viibridges/crossnet) | 76 | SIMS | Semi-parametric Image Synthesis | CVPR 2018 | [1804.10992](https://arxiv.org/abs/1804.10992) | [xjqicuhk/SIMS](https://github.com/xjqicuhk/SIMS) | 77 | Pix2PixHD | High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs | CVPR 2018 | [1711.11585](https://arxiv.org/abs/1711.11585) | [NVIDIA/pix2pixHD](https://github.com/NVIDIA/pix2pixHD) | 78 | X-Fork & X-Seq | Cross-View Image Synthesis using Conditional GANs | CVPR 2018 | [1803.03396](https://arxiv.org/abs/1803.03396) | [kregmi/cross-view-image-synthesis](https://github.com/kregmi/cross-view-image-synthesis) | 79 | Vid2Vid | Video-to-Video Synthesis | NeurIPS 2018 | [1808.06601](https://arxiv.org/abs/1808.06601) | [NVIDIA/vid2vid](https://github.com/NVIDIA/vid2vid) | 80 | SPADE | Semantic Image Synthesis with Spatially-Adaptive Normalization | CVPR 2019 | [1903.07291](https://arxiv.org/abs/1903.07291) | [NVlabs/SPADE](https://github.com/NVlabs/SPADE) | 81 | SelectionGAN | Multi-Channel Attention Selection GAN with Cascaded Semantic Guidance for Cross-View Image Translation | CVPR 2019 | [1904.06807](https://arxiv.org/abs/1904.06807) | [Ha0Tang/SelectionGAN](https://github.com/Ha0Tang/SelectionGAN) | 82 | Art2Real | Art2Real: Unfolding the Reality of Artworks via Semantically-Aware Image-to-Image Translation | CVPR 2019 | [1811.10666](https://arxiv.org/abs/1811.10666) | [aimagelab/art2real](https://github.com/aimagelab/art2real) | 83 | | | Mask-Guided Portrait Editing with Conditional GANs | CVPR 2019 | [1905.10346](https://arxiv.org/abs/1905.10346) | [cientgu/Mask_Guided_Portrait_Editing](https://github.com/cientgu/Mask_Guided_Portrait_Editing) | 84 | Seg2Vid | Video Generation from Single Semantic Label Map | CVPR 2019 | [1903.04480](https://arxiv.org/abs/1903.04480) | [junting/seg2vid](https://github.com/junting/seg2vid) | 85 | | | Semantic Bottleneck Scene Generation | | [1911.11357](https://arxiv.org/abs/1911.11357) | | 86 | Few-shot Vid2Vid | Few-shot Video-to-Video Synthesis | NeurIPS 2019 | [1910.12713](https://arxiv.org/abs/1910.12713) | [NVlabs/few-shot-vid2vid](https://github.com/NVlabs/few-shot-vid2vid) | 87 | CC-FPSE | Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesis | NeurIPS 2019 | [1910.06809](https://arxiv.org/abs/1910.06809) | [xh-liu/CC-FPSE](https://github.com/xh-liu/CC-FPSE) | 88 | SEAN | SEAN: Image Synthesis with Semantic Region-Adaptive Normalization | CVPR 2020 | [1911.12861](https://arxiv.org/abs/1911.12861) | [ZPdesu/SEAN](https://github.com/ZPdesu/SEAN) | 89 | BachGAN | BachGAN: High-Resolution Image Synthesis from Salient Object Layout | CVPR 2020 | [2003.11690](https://arxiv.org/abs/2003.11690) | [Cold-Winter/BachGAN](https://github.com/Cold-Winter/BachGAN) | 90 | | | Panoptic-based Image Synthesis | CVPR 2020 | [2004.10289](https://arxiv.org/abs/2004.10289) | | 91 | SMIS | Semantically Multi-modal Image Synthesis | CVPR 2020 | [2003.12697](https://arxiv.org/abs/2003.12697) | [Seanseattle/SMIS](https://github.com/Seanseattle/SMIS) | 92 | GAN Compression | GAN Compression: Efficient Architectures for Interactive Conditional GANs | CVPR 2020 | [2003.08936](https://128.84.21.199/abs/2003.08936) | [mit-han-lab/gan-compression](https://github.com/mit-han-lab/gan-compression) | 93 | LGGAN | Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generation | CVPR 2020 | [1912.12215](https://arxiv.org/abs/1912.12215) | [Ha0Tang/LGGAN](https://github.com/Ha0Tang/LGGAN) | 94 | TSIT | TSIT: A Simple and Versatile Framework for Image-to-Image Translation | ECCV 2020 | [2007.12072](https://arxiv.org/abs/2007.12072) | [EndlessSora/TSIT](https://github.com/EndlessSora/TSIT) | 95 | SegVAE | Controllable Image Synthesis via SegVAE | ECCV 2020 | [2007.08397](https://arxiv.org/abs/2007.08397) | [yccyenchicheng/SegVAE](https://github.com/yccyenchicheng/SegVAE) | 96 | SESAME | SESAME: Semantic Editing of Scenes by Adding, Manipulating or Erasing Objects | ECCV 2020 | [2004.04977](https://arxiv.org/abs/2004.04977) | | 97 | Style Semantics | Controlling Style and Semantics in Weakly-Supervised Image Generation | ECCV 2020 | [1912.03161](https://arxiv.org/abs/1912.03161) | [dariopavllo/style-semantics](https://github.com/dariopavllo/style-semantics) | 98 | 99 | ## Texture Patch Guided 100 | Model | Paper | Conference | Arxiv | Code | 101 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 102 | TextureGAN | TextureGAN: Controlling Deep Image Synthesis with Texture Patches | CVPR 2018 | [1706.02823](https://arxiv.org/abs/1706.02823) | [janesjanes/Pytorch-TextureGAN](https://github.com/janesjanes/Pytorch-TextureGAN) | 103 | Guided-pix2pix | Guided Image-to-Image Translation with Bi-Directional Feature Transformation | ICCV 2019 | [1910.11328](https://arxiv.org/abs/1910.11328) | [vt-vl-lab/Guided-pix2pix](https://github.com/vt-vl-lab/Guided-pix2pix) 104 | 105 | ## Example Guided 106 | Model | Paper | Conference | Arxiv | Code | 107 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 108 | EG-UNIT | Exemplar Guided Unsupervised Image-to-Image Translation | ICLR 2019 | [1805.11145](https://arxiv.org/abs/1805.11145) | [charliememory/EGSC-IT](https://github.com/charliememory/EGSC-IT) | 109 | Pix2pixSC | Example-Guided Style-Consistent Image Synthesis from Semantic Labeling | CVPR 2019 | [1906.01314](https://arxiv.org/abs/1906.01314) | [cxjyxxme/pix2pixSC](https://github.com/cxjyxxme/pix2pixSC) 110 | 111 | ## Attention Guided 112 | Model | Paper | Conference | Arxiv | Code | 113 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 114 | DA-GAN | DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks | CVPR 2018 | [1802.06454](https://arxiv.org/abs/1802.06454) 115 | Attention-GAN | Attention-GAN for Object Transfiguration in Wild Images | ECCV 2018 | [1803.06798](https://arxiv.org/abs/1803.06798) | 116 | UAIT | Unsupervised Attention-guided Image to Image Translation | NeurIPS 2018 | [1806.02311](https://arxiv.org/abs/1806.02311) | [AlamiMejjati/Unsupervised-Attention-guided-Image-to-Image-Translation](https://github.com/AlamiMejjati/Unsupervised-Attention-guided-Image-to-Image-Translation) | 117 | | | Show, Attend and Translate: Unsupervised Image Translation with Self-Regularization and Attention | TIP 2019 | [1806.06195](https://arxiv.org/abs/1806.06195) | 118 | AttentionGAN | Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation | IJCNN 2019 | [1903.12296](https://arxiv.org/abs/1903.12296) | [Ha0Tang/AttentionGAN](https://github.com/Ha0Tang/AttentionGAN) | 119 | U-GAT-IT | U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation | ICLR 2020 | [1907.10830](https://arxiv.org/abs/1907.10830) | [taki0112/UGATIT](https://github.com/taki0112/UGATIT), [znxlwm/UGATIT-pytorch](https://github.com/znxlwm/UGATIT-pytorch) | 120 | 121 | ## Mask Guided 122 | Model | Paper | Conference | Arxiv | Code | 123 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 124 | ContrastGAN | Generative Semantic Manipulation with Mask-Contrasting GAN | ECCV 2018 | [1708.00315](https://arxiv.org/abs/1708.00315) | | 125 | InstaGAN | Instance-aware image-to-image translation | ICLR 2019 | [1812.10889](https://arxiv.org/abs/1812.10889) | [sangwoomo/instagan](https://github.com/sangwoomo/instagan) | 126 | INIT | Towards Instance-level Image-to-Image Translation | CVPR 2019 | [1905.01744](https://arxiv.org/abs/1905.01744) | [project](http://zhiqiangshen.com/projects/INIT/index.html) | 127 | 128 | ## Text Guided 129 | Model | Paper | Conference | Arxiv | Code | 130 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 131 | ControlGAN | Controllable Text-to-Image Generation | NeurIPS 2019 | [1909.07083](https://arxiv.org/abs/1909.07083) | [mrlibw/ControlGAN](https://github.com/mrlibw/ControlGAN) | 132 | DMIT | Multi-mapping Image-to-Image Translation via Learning Disentanglement | NeurIPS 2019 | [1909.07877](https://arxiv.org/abs/1909.07877) | [Xiaoming-Yu/DMIT](https://github.com/Xiaoming-Yu/DMIT) | 133 | ManiGAN | ManiGAN: Text-Guided Image Manipulation | | [1912.06203](https://arxiv.org/abs/1912.06203) | | 134 | RefinedGAN | Image-to-Image Translation with Text Guidance | | [2002.05235](https://128.84.21.199/abs/2002.05235) | | 135 | 136 | ## Audio Guided 137 | Model | Paper | Conference | Arxiv | Code | 138 | ----------------------------------------- | ------------------------------------------------------------ | ---------- | ---------------------------------------------- | ------------------------------------------------------------ | 139 | X2Face | X2Face: A Network for Controlling Face Generation using Images, Audio, and Pose Codes | ECCV 2018 | [1807.10550](https://arxiv.org/abs/1807.10550) | [oawiles/X2Face](https://github.com/oawiles/X2Face) | 140 | 141 | --------------------------------------------------------------------------------