├── vif-time-line.png └── README.md /vif-time-line.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xingchenzhang/Visible-infrared-image-fusion-based-on-deep-learning/HEAD/vif-time-line.png -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Deep learning-based visible and infrared image fusion: papers & codes 2 | This is the repository corresponding to our TPAMI2023 paper "[Visible and Infrared Image Fusion Using Deep Learning](https://ieeexplore.ieee.org/abstract/document/10088423)". 3 | 4 | A list of papers, datasets (benchmarks) and codes in deep learning-based visible and infrared image fusion methods. 5 | - If you think this is useful, please consider citing our paper and giving a star, thanks! 6 | - If you think some papers are missing and you want to add, please feel free to raise an issue or contact me. 7 | - Contact detail: xingchen.zhang@imperial.ac.uk 8 | 9 | ## Table of Contents 10 | 1. [Timeline](#Timeline) 11 | 2. [Visible-infrared image fusion (VIF)](#Visible-infrared-image-fusion) 12 | - [Review](#Review) 13 | - [Benchmark](#Benchmark) 14 | - [2023](#2023) 15 | - [2022](#2022) 16 | - [2021](#2021) 17 | - [2020](#2020) 18 | - [2019](#2019) 19 | - [2018](#2018) 20 | 21 | 3. [General image fusion](#General-image-fusion) 22 | - [GIF-Review](#GIF-Review) 23 | - [GIF-2023](#GIF-2023) 24 | - [GIF-2022](#GIF-2022) 25 | - [GIF-2021](#GIF-2021) 26 | - [GIF-2020](#GIF-2020) 27 | - [GIF-2019](#GIF-2019) 28 | 29 | ## Timeline 30 | ![](vif-time-line.png) 31 | 32 | ## Visible-infrared image fusion 33 | ### Review 34 | 1. Changqi Sun, Cong Zhang, Naixue Xiong. 35 | **Infrared and Visible Image Fusion Techniques Based on Deep Learning: A Review**, Electronics, 2020. 36 | 37 | 2. Jiayi Ma, Yong Ma, Chang Li. 38 | **Infrared and visible image fusion methods and applications: A survey**, Information Fusion, vol.45, pp.153-178,2019. 39 | 40 | 3. Ami Patel, Jayesh Chaudhary. 41 | **A Review on Infrared and Visible Image Fusion Techniques**, ICICV, 2019. 42 | 43 | ### Benchmark 44 | 1. Xingchen Zhang, Ping Ye, Gang Xiao. 45 | **VIFB: a visible and infrared image fusion benchmark**, CVPRW, 2020. [[Code](https://github.com/xingchenzhang/VIFB)] 46 | 47 | ### 2023 48 | 49 | ### 2022 50 | #### Journal 51 | 1. Chang Liu, Bin Yang, Xiaozhi Zhang, Lihui Pang. 52 | **IBPNet: a multi-resolution and multi-modal image fusion networkvia iterative back-projection**, Applied Intelligence, 2022. 53 | 54 | 2. Wanxin Xiao , Yafei Zhang , Hongbin Wang ,Fan Li ,and Hua Jin. 55 | **Heterogeneous Knowledge Distillation for Simultaneous Infrared-Visible Image Fusion and Super-Resolution**, IEEE Transactions on Instrumentation and Measurement, 2022. 56 | 57 | 3. Hongmei Wang, Wenbo An, Lin Li, Chenkai Li, Daming Zhou. 58 | **Infrared and visible image fusion based on multi-channel convolutional neural network**, IET Image Processing, 2022. 59 | 60 | 4. Jingjing Wang, Jinwen Ren, Hongzhen Li, Zengzhao Sun, Zhenye Luan, Zishu Yu, Chunhao Liang, Yashar E. Monfared, Huaqiang Xu and Qing Hua. 61 | **DDGANSE: Dual-Discriminator GAN with a Squeeze-and-Excitation Module for Infrared and Visible Image Fusion**, photonics, 2022. 62 | 63 | 5. Zhiguang Yang and Shan Zeng. 64 | **TPFusion: Texture Preserving Fusion of Infrared and Visible Images via Dense Networks**, Entropy, 2022. 65 | 66 | 6. Zhisheng Gao, Qiaolu Wang, Chenglin Zuo. 67 | **A total variation global optimization framework and its application on infrared and visible image fusion**, Signal, Image and Video Processing, 2022. [[Code]](https://github.com/gzsds/globaloptimizationimagefusion) 68 | 69 | 7. Zhishe Wang, Yuanyuan Wu, Junyao Wang, Jiawei Xu, Wenyu Shao. 70 | **Res2Fusion: Infrared and visible image fusion based on dense Res2net and double non-local attention models**, IEEE Transactions on Instrumentation and Measurement, 2022. 71 | 72 | 8. Xin Yang, Hongtao Huo, Jing Li, Chang Li, Zhao Liu, Xun Chen. 73 | **DSG-Fusion: Infrared and visible image fusion via generative adversarial networks and guided filter**, Expert Systems With Applications, 2022. 74 | 75 | 9. Liming Zhang, Heng Li, Rui Zhu, Ping Du. 76 | **An infrared and visible image fusion algorithm based on ResNet-152**, Multimedia Tools and Applications, 2022. 77 | 78 | 10. Xianglong Chen, Haipeng Wang, Yaohui Liang, Ying Meng, Shifeng Wang. 79 | **A Novel Infrared and Visible Image Fusion Approach Based on Adversarial Neural Network**, Sensors, 2022. 80 | 81 | #### Conference 82 | 83 | #### arXiv 84 | 1. Dongyu Rao, Xiao-Jun Wu, Tianyang Xu 85 | **TGFuse: An Infrared and Visible Image Fusion Approach Based on Transformer and Generative Adversarial Network**, 2022. 86 | 87 | 2. Zhancheng Zhang, Yuanhao Gao, Mengyu Xiong, Xiaoqing Luo and Xiao-Jun Wu. 88 | **A Joint Convolution Auto-encoder Network for Infrared and Visible Image Fusion**, 2022. 89 | 90 | 3. Zhishe Wang, Wenyu Shao, Yanlin Chen, Jiawei Xu, Xiaoqin Zhang. 91 | **Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning**, 2022. 92 | 93 | ### 2021 94 | #### Journal 95 | 1. Kan Ren, Dawei Zhang, Minjie Wan, Xin Miao, Guohua Gu, Qian Chen. 96 | **An infrared and visible image fusion method based on improved DenseNet and mRMR-ZCA**, Infrared Physics and Technology, Vol. 115, 2021. [[Paper](https://reader.elsevier.com/reader/sd/pii/S1350449521000797?token=6BAAE584B5078A0E8AB9F4470FE80E104AEE08795144F74BAC19E02E65A9738CDD10DBEA5310D5404113D5C0DC249890&originRegion=eu-west-1&originCreation=20210404131056)] 97 | 98 | 2. Hui Li, Xiao-Jun Wu, Josef Kittler. 99 | **RFN-Nest: An end-to-end residual fusion network for infrared and visible images**, Information Fusion, 2021. [[Pytorch](https://github.com/hli1221/imagefusion-rfn-nest)] 100 | 101 | 3. Yu Fu, Xiao-Jun We, Tariq Durrani. 102 | **Image fusion based on generative adversarial network consistent with perception**, Information Fusion, 2021. 103 | 104 | 4. Yongzhi Long, Haitao Jia, Yida Zhong, Yadong Jiang, Yuming Jia. 105 | **RXDNFuse: A aggregated residual dense network for infrared and visible image fusion**, Information Fusion, Vol. 69, 2021. 106 | 107 | 5. Lihua Jian, Xiaomin Yang, Zheng Liu, Gwanggil Jeon, Mingliang Gao, David Chisholm. 108 | **SEDRFuse: A Symmetric Encoder-Decoder With Residual Block Network for Infrared and Visible Image Fusion**, IEEE Transactions on Instrumentation and Measurement, Vol. 70, 2021. 109 | 110 | 6. Han Xu, Xinya Wang, Jiayi Ma. 111 | **DRF: Disentangled Representation for Visible and Infrared Image Fusion**, IEEE Transactions on Instrumentation and Measurement, Vol. 70, 2021. 112 | 113 | 7. Jiayi Ma, Hao Zhang, Zhenfeng Shao, Pengwei Liang, Han Xu. 114 | **GANMcC: A Generative Adversarial Network With Multiclassification Constraints for Infrared and Visible Image Fusion**, IEEE Transactions on Instrumentation and Measurement, Vol. 70, 2021. [[Tensorflow](https://github.com/jiayi-ma/GANMcC)] 115 | 116 | 8. Yong Yang, Jiaxiang Liu, Shuying Huang, Weiguo Wan, Wenying Wen, Juwei Guan. 117 | **Infared and Visible Image Fusion via Texture Conditional Generative Adversarial Network**, IEEE Transactions on Circuits and Systems for Video Technology, 2021. 118 | 119 | 9. Jinyuan Liu, Xin Fan, Ji Jiang, Risheng Liu, Zhongxuan Luo. 120 | **Learning a Deep Multi-scale Feature Ensemble and an Edge-attention Guidance for Image Fusion**, IEEE Transactions on Circuits and Systems for Video Technology, 2021. [[No code](https://github.com/JinyuanLiu-CV/MFEIF)] 121 | 122 | 10. Asif Raza, Jingdong Liu, Yifan Liu, Zeng Li, Jian Liu, Xi Chen, Hong Huo, Tao Fang. 123 | **IR-MSDNet: Infrared and Visible Image Fusion based on Infrared Features & Multiscale Dense Network**, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sesing, 2021. 124 | 125 | 11. Zhao Xu, Gang Liu, Lili Tang, Yanhui Li. 126 | **Blur Regional Features Based Infrared and Visible Image Fusion Using An Improved C3Net Model**, Journal of Physics: Conference Series, 2021. 127 | 128 | 12. Yue Pan, Dechang Pi, Lzhar Ahmed Khan, Zaheer Ullah Khan, Junfu Chen, Han Meng. 129 | **DenseNetFuse: a study of deep unsupervised DenseNet to infrared and visual image fusion**, Journal of Ambient Intelligent and Humanized Computing2021. 130 | 131 | 13. Yansong Gu, Xinya Wang, Can Zhang, Baiyang Li. 132 | **Advanced Driving Assistance Based on the Fusion of Infrared and Visible Images**, Entropy, 2021. 133 | 134 | 14. Jilei Hou, Dazhi Zhang, Wei Wu, Jiayi Ma, Huabing Zhou. 135 | **A Generative Adversarial Network for Infrared and Visible Image Fusion Based on Semantic Segmentation**, Entropy, 2021. 136 | 137 | 15. Heena Patel, Kishor P. Upla. 138 | **DepthFuseNet: an approach for fusion of thermal and visible images usings a convolution neural network**, Optical Engineering, 2021. 139 | 140 | 16. Yong Yang, Jia-Xiang Liu, Shu-Ying Huang, Hang-Yang Lu, Wen-Ying Wen. 141 | **VMDM-fusion: a saliency feature representation method for infrared and visible image fusion**, Signal, Image and Video Processing, 2021. 142 | 143 | 17. Qilei Li, Lu Lu, Zhen Li, Wei Wu, Zheng Liu, Gwanggil Jeon, Xiaomin Yang. 144 | **Coupled GAN with relativistic discriminators for infrared and visible images fusion**, IEEE Sensors Journal, Vol. 21, No. 6, 2021. 145 | 146 | 18. Huabing Hua, Jilei Hou, Wei Wu, Yanduo Zhang, Yuntao Wu, Jiayi Wu. 147 | **Infrared and Visible Image Fusion Based on Semantic Segmentation**, Journal of Computer Research and Development, Vol. 58, No. 2, 2021. 148 | 149 | 19. Huafeng Li, Yueliang Cen, Yu Liu, Xun Chen, Zhengtao Yu. 150 | **Different Input Resolutions and Arbitrary Output Resolution: A Meta Learning-based Deep Framework for Infrared and Visible Image Fusion**, IEEE TIP, Vol. 30, 2021.[[Paper](https://ieeexplore.ieee.org/abstract/document/9394791?casa_token=-nkpqpQWRb4AAAAA:21H-Z6Eqx7GtRmIoUYv4AMSmv3p-21K-UxVzBYC1b4j7LAETAB4t1eo_406PnZEBon2jcbHB)][Pytorch](https://github.com/yuliu316316/MetaLearning-Fusion)] 151 | 152 | 20. Zhao Xu, Gang Liu, Gang Xiao, Lili Tang, Yanhui Li. 153 | **JCa2Co: A joint cascade convolution coding network based on fuzzy regional characteristics for infrared and visible image fusion**, IET Computer Vision, 2021. 154 | 155 | 21. Jiayi Ma, Linfeng Tang, Meilong Xu, Hao Zhang, Guobao Xiao. 156 | **STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection**, IEEE Transactions on Instrumentation and Measurement, 2021. [[Tensorflow](https://github.com/jiayi-ma/STDFusionNet)] 157 | 158 | 22. Zixiang Zhao, Shuang Xu, Jiangshe Zhang, Chengyang Liang, Chunxia Zhang, Junmin Liu. 159 | **Efficient and Model-Based Infrared and Visible Image Fusion via Algorithm Unrolling**, IEEE TCSVT, 2021. 160 | 161 | 23. Juan Wang, Cong Ke, Minghu Wu, Min Liu, Chunyan Zeng. 162 | **Infrared and visible image fusion based on Laplacian pyramid and generative adversarial network**, KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, vol. 15, no. 5, 2021. 163 | 164 | 24. Luolin Liu, Mulin Chen, Mingliang Xu, Xuelong Li. 165 | **Two-Stream Network for Infrared and Visible Images Fusion**, Neurocomputing, 2021. 166 | 167 | 25. Yu Fu, Xiaojun Wu, Josef Kittler. 168 | **Effective method for fusing infrared and visible images**, Journal of Electronic Imaging, 2021. 169 | 170 | #### Conference 171 | 1. Yan Zou, Linfei Zhang, Chengqian Liu, Bowen Wang, Yan Hu, Qian Chen. 172 | **Infrared visible color night image fusion based on deep learning**, Proc. of SPIE, 2021. 173 | 174 | 2. Jixiao Wang, Yang Li, Zhuang Miao. 175 | **A New Infrared and Visible Image Fusion Method Based on Generative Adversarial Networks and Attention Mechanism**, ICIGP, 2021. 176 | 177 | 3. Yu Fu, Xiao-Jun Wu. 178 | **A Dual-branch Network for Infrared and Visible Image Fusion**, ICPR, 2021. 179 | 180 | #### arXiv 181 | 1. Yu Fu, Xiao-Jun Wu, Josef Kittler. 182 | **A Deep Decomposition Network for Image Processing: A Case Study for Visible and Infrared Image Fusion**, arXiv, 2021. 183 | 184 | 2. Yu Fu, TianYang Xu, XiaoJun Wu, Josef Kittler. 185 | **PPT Fusion: Pyramid Patch Transformerfor a Case Study in Image Fusion**, 2021. 186 | 187 | 188 | ### 2020 189 | #### Journal 190 | 1. Jiayi Ma, Han Xu, Junjun Jiang, Xiaoguang Mei, Xiao-Ping Zhang. 191 | **DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion**, IEEE Transactions on Image Processing, Vol. 29, 2020. [[Tensorflow](https://github.com/jiayi-ma/DDcGAN)] 192 | 193 | 2. Ruichao Hou, Dongming Zhou, Rencan Nie, Dong Liu, Lei Xiong, Yanbu Guo, Chuanbo Yu. 194 | **VIF-Net: An Unsupervised Framework for Infrared and Visible Image Fusion**, IEEE Transactions on Computational Imaging, Vol. 6, 2020. 195 | 196 | 3. Jing Li, Hongtao Huo, Chang Li, Renhua Wang, Qi Feng. 197 | **AttentionFGAN: Infrared and Visible Image Fusion using Attention-based Generative Adversarial Networks**, IEEE Transactions on Multimedia, 2020. 198 | 199 | 4. Jiayi Ma, Pengwei Liang, Wei Yu, Chen Chen, Xiaojie Guo, Jia Wu, Junjun Jiang. 200 | **Infrared and Visible image fusion via detail preserving adversarial learning**, Information Fusion, vol. 54, 2020. 201 | 202 | 5. C. Yuan, C. Q. Sun, X. Y. Tang, R. F. Liu. 203 | **FLGC-Fusion GAN: An Enhanced Fusion GAN Model by Importing Fully Learnable Group Convolution**, Mathematical Problems in Engineering, 2020. 204 | 205 | 6. Yongxin Zhang, Deguang Li, Wenpeng Zhu. 206 | **Infrared and Visible Image Fusion with Hybrid Image Filtering**, Mathematical Problems in Engineering, 2020. 207 | 208 | 7. Yuqing Zhao, Guangyuan Fu, Hongqiao Wang, Shaolei Zhang. 209 | **The Fusion of Unmatched Infrared and Visible Images Based on Generative Adversarial Networks**, Mathematical Problems in Engineering, 2020. 210 | 211 | 8. Yufang Feng, Houqing Lu, Jingbo Bai, Lin Cao, Hong Yin. 212 | **Fully convolutional network-based infrared and visible image fusion**, Multimedia Tools and Applications, 2020. 213 | 214 | 9. Yang Li, Jixiao Wang, Zhuang Miao, Jiabao Wang. 215 | **Unsupervised densely attentional network for infrared and visible image fusion**, Multimedia Tools and Applications, 2020. 216 | 217 | 10. Bin Liao, You Du, Xiangyun Yin. 218 | **Fusion of Infrared-Visible Images in UE-IOT for Fault Point Detection Based on GAN**, IEEE Access, 2020. 219 | 220 | 11. Lei Yan, Jie Cao, Saad Rizvi, Kaiyu Zhang, Qun Hao, Xuemin Cheng. 221 | **Improving the performance of image fusion based on visual saliency weight map combined with CNN**, IEEE Access, 2020. 222 | 223 | 12. Hafiz Tayyab Mustafa, Jie Yang, Hamza Mustafa, Masoumeh Zareapoor. 224 | **Infrared and visible image fusion based on dilated residual attention network**, Optik, 2020. 225 | 226 | 13. Jing Li, Hongtao Huo, Kejian Liu, Chang Li. 227 | **Infrared and visible image fusion using dual discriminators generative adversirial networks with Wasserstein distance**, Information Sciences, Vol. 59, 2020. 228 | 229 | 14. Dongdong Xu, Yongcheng Wang, Shuyan Xu, Kaiguang Zhu, Ning Zhang, Xin Zhang. 230 | **Infrared and Visible Image Fusion with a Generative Adversarial Network and a Residual Network**, Applied Science, 2020. 231 | 232 | 15. Wen-Bo An, Hong-Mei Wang. 233 | **Infrared and visible image fusion with supervised convolutional neural network**, Optik, 2020. 234 | 235 | 16. Jiangtao Xu, Xingping Shi, Shuzhen Qin, Kaige Lu, Han Wang, Jianguo Ma. 236 | **LBP-BEGAN: A generative adversarial network archiecture for infrared and visible image fusion**, Infrared Physics & Technology, Vol. 104, 2020. 237 | 238 | 17. Jiahui Zhu, Qingyu Dou, Lihua Jian, Kai Liu, Farhan Hussain, Xiaomin Yang. 239 | **Multiscale channel attention network for infrared and visible image fusion**, Concurrency Computational, 2020. 240 | 241 | 242 | 243 | #### Conference 244 | 1. Zixiang Zhao, Shuang Xu, Chunxia Zhang, Junmin Liu, Pengfei Li, Jiangshe Zhang. 245 | **DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusion**, IJCAI, 2020. 246 | 247 | 2. Heena Patel, Kalpesh Prajapati, Vishal Chudasama, Kishor P. Upla. 248 | **An Approach for Fusion of Thermal and Visible Images**, International Conference on Emerging Technology Trends in Electronics Communication and Networking, 2020. 249 | 250 | #### arXiv 251 | 1. Aiqing Fang, Xinbo Zhao, Jiaqi Yang, Shihao Cao, Yanning Zhang. 252 | **AE-Net: Autonomous Evolution Image Fusion Method Inspired by Human Cognitive Mechanism**, arXiv, 2020. 253 | 254 | 2. Aiqing Fang, Xinbo Zhao, Jiaqi Yang, Beibei Qin, Yanning Zhang. 255 | **AE-Net2: Optimization of Image Fusion Efficiency and Network Architecture**, arXiv, 2020. 256 | 257 | 3. Zixiang Zhao, Shuang Xu, Chunxia Zhang, Junmin Liu, Jiangshe Zhang. 258 | **Efficient and Interpretable Infrared and Visible Image Fusion Via Algorithm Unrolling**, arXiv, 2020. 259 | 260 | 4. Snigdha Bhagat, S. D. Joshi, Brejesh Lall. 261 | **Image fusion using symmetric skip autoencoder via an Adversarial Regulariser**, arXiv, 2020. 262 | 263 | 5. Shaolei Liu, Manning Wang, Zhijian Song. 264 | **WaveFuse: A Unified Deep Framework for Image Fusion with Discrete Wavelet Transform**, arXiv, 2020. 265 | 266 | 6. Zixiang Zhao, Shuang Xu, Rui Feng, Chunxia Zhang, Junmin Liu, Jiangshe Zhang. 267 | **When Image Decomposition Meets Deep Learning: A Novel Infrared and Visible Image Fusion Method**, arXiv, 2020. 268 | 269 | 270 | ### 2019 271 | #### Journal 272 | 1. Hui Li, Xiao-Jun Wu. 273 | **DenseFuse: A Fusion Approach to Infrared and Visible Images**, IEEE TIP, Vol. 28, No. 5, 2019. 274 | 275 | 2. Jiayi Ma, Wei Yu, Pengwei Liang, Chang Li, Junjun Jiang. 276 | **FusionGAN: A generative adversarial network for infrared and visible image fusion**, Information Fusion, Vol. 48, 2019. 277 | 278 | 3. Jingchun Piao, Yunfan Chen, Hyunchul Shin. 279 | **A New Deep Learning Based Multi-Spectral Image Fusion Method**, Entropy, 2019. 280 | 281 | 4. Ivana Shopovska, Ljubomir Jovanov, Wilfried Philips. 282 | **Deep Visible and Thermal Image Fusion for Enhanced Pedestrian Visibility**, Sensors, 2019. 283 | 284 | 5. Yaochen Liu, Lili Dong, Yuanyuan Ji, Wenhai Xu. 285 | **Infrared and Visible Image Fusion through Details Preservation**, Sensors, 2019. 286 | 287 | 6. Yinchan Cui, Huiqian Du, Wenbo Mei. 288 | **Infrared and Visible Image Fusion Using Detail Enhanced Channel Attention Network**, IEEE Access, 2019. 289 | 290 | 7. Hui Li, Xiao-Jun Wu, Tariq S. Durrani. 291 | **Infrared and visible image fusion with ResNet and zero-phase component analysis**, Infrared Physics & Technology, Vol. 102, 2019. [[Matlab](https://github.com/hli1221/imagefusion_resnet5)] 292 | 293 | #### Conference 294 | 1. Han Xu, Pengwei Liang, Wei Yu, Junjun Jiang, Jiayi Ma. 295 | **Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators**, IJCAI, 2019. 296 | 297 | 2. Yun Ge, Guodong Jing. 298 | **Infrared and Visible Image Fusion Using Multi-resolution Convolution Neural Network**, International Conference on Artificial Intelligence, Information Processing and Cloud Computing, 2019. 299 | 300 | 3. Jing Li, Hongtao Huo, Kejian Liu, Chang Li, Shuo Li, Xin Yang. 301 | **Infrared and Visible Image Fusion via Multi-Discriminators Wasserstein Generative Adversarial Network**, International Conference on Machine Learning and Applications, 2019. 302 | 303 | 4. Lebedev M. A., Komarov D. V., Vygolov O. V., Vizilter Yu. V. 304 | **Multisensor Image Fusion based on Generative Adversarial Networks**, Image and Signal Processing for Remote Sensing, 2019. 305 | 306 | 307 | ### 2018 308 | #### Journal 309 | 1. Wei Wu, Zongming Qiu, Min Zhao, Qiuhong Huang, Yang Lei. 310 | **Visible and infrared image fusion using NSST and deep Boltzmann machine**, Optik, Vol. 157, 2018. 311 | 312 | 2. Yu Liu, Xun Chen, Juan Cheng, Hu Peng. 313 | **Infrared and visible image fusion with convolutional neural networks**, International Journal of Wavelets, Multiresolution and Information Processing, Vol. 16, No. 2, 2018. 314 | 315 | #### Conference 316 | 1. Hui Li, Xiao-Jun Wu, Josef Kittler. 317 | **Infrared and Visible Image Fusion using a Deep Learning Framework**, ICPR, 2018. [[Matlab](https://github.com/hli1221/imagefusion_deeplearning)] 318 | 319 | 2. Xianyi Ren, Fanyang Meng, Tao Hu, Zhijun Liu, Changwei Wang. 320 | **Infrared-visible Image Fusion Based on Convolutional Neural Networks**, International Conference on Intelligent Science and Big Data Engineering, 2018. 321 | 322 | 323 | 324 | ## General-image-fusion 325 | 326 | ### GIF-Review 327 | 1. Harpreet Kaur, Deepika Koundal, Virender Kadyan. 328 | **Image Fusion Techniques: A Survey**, Archives of Computational Methods in Engineering, 2021. 329 | 330 | 2. Simrandeep Singh, Nitin Mittal, Harbinder Singh. 331 | **Review of Various Image Fusion Algorithms and Image Fusion Peformance Metric**, Archives of Computational Methods in Engineering, 2021. 332 | 333 | 334 | ### GIF-2023 335 | #### Journal 336 | 337 | ### GIF-2022 338 | #### Journal 339 | 340 | ### GIF-2021 341 | #### Journal 342 | 1. Risheng Liu, Jinyuan Liu, Zhiying Jiang, Xin Fan, Zhongxuan Luo. 343 | **A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion**, IEEE Transactions on Image Processing, Vol, 30, 2021. [**MedIF, VIF**] 344 | 345 | #### arXiv 346 | 1. Zhengwen Shen, Jun Wang, Zaiyu Pan, Yulian Li, Jiangyu Wang, 347 | **Cross Attention-guided Dense Network for Images Fusion**, arXiv.2109.11393v1. 348 | 349 | ### GIF-2020 350 | #### Journal 351 | 1. Han Xu, Jiayi Ma, Junjun Jiang, Xiaojie Guo, Haibin Ling. 352 | **U2Fusion: A Unified Unsupervised Image Fusion Network**, IEEE TPAMI,2020. [[Tensorflow](https://github.com/hanna-xu/U2Fusion)] 353 | 354 | 2. Asif Raza, Hong Huo, Tao Fang. 355 | **PFAF-Net: Pyramid Feature Network for Multimodal Fusion**, IEEE Sensors Journal, Vol. 4, No. 12, 2020 356 | 357 | 3. Xin Deng, Pier Luigi Dragotti. 358 | **Deep Convolutional Neural Network for Multi-modal Image Restoration and Fusion**, IEEE TPAMI, 2020. (MFIF, MEF, MedIF) 359 | 360 | 4. Fan Zhao, Wenda Zhao. 361 | **Learning Specific and General Realm Feature Representations for Image Fusion**, IEEE Transactions on Multimedia, 2020. 362 | 363 | 5. Yu Zhang, Yu Liu, Peng Sun, Han Yan, Xiaolin Zhao, Li Zhang. 364 | **IFCNN: A general image fusion framework based on convolutional neural network**, Information Fusion, Vol. 54, 2020. 365 | 366 | 6. Hyungjoo Jung, Youngjun Kim, Hyunsung Jang, Namkoo Ha, Kwanghoon Sohn. 367 | **Unsupervised Deep Image Fusion With Structure Tensor Representations**, IEEE Transactions on Image Processing, Vol. 29, 2020. 368 | 369 | #### Conference 370 | 1. Han Xu, Jiayi Ma, Zhuliang Le, Junjun Jiang, Xiaojie Guo. 371 | **FusionDN: A Unified Densely Connected Network for Image Fusion**, AAAI, 2020. 372 | 373 | 2. Hao Zhang, Han Xu, Yang Xiao, Xiaojie Guo, Jiayi Ma. 374 | **Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity**, AAAI, 2020. 375 | 376 | ### GIF-2019 377 | #### Journal 378 | 1. Meng Wang, Xingwang Liu, Huaiping Jin. 379 | **A generative image fusion approach based on supervised deep convolutional network driven by weighted gradient flow**, Image and Vision Computing, Vol. 86, 2020. 380 | 381 | #### arXiv 382 | 1. Fayez Lahoud, Sabine Susstruck. 383 | **Fast and Efficient Zero-Learning Image Fusion**, arXiv, 2019. 384 | 385 | ## Citation 386 | If you find this work is useful, please consider citing our paper: 387 | 388 | @article{zhang2023visible, 389 | title={Visible and Infrared Image Fusion Using Deep Learning}, 390 | author={Zhang, Xingchen and Demiris, Yiannis}, 391 | journal={IEEE Transactions on Pattern Analysis and Machine Intelligence}, 392 | year={2023}, 393 | publisher={IEEE} 394 | } 395 | 396 | 397 | --------------------------------------------------------------------------------