End to End Infrared and Visible Image Fusion With Texture Details and Contrast Information

Bibliographic Details
Title: End to End Infrared and Visible Image Fusion With Texture Details and Contrast Information
Authors: Jingyu Ji, Yuhua Zhang, Zhilong Lin, Yongke Li, Changlong Wang, Yongjiang Hu, Fuyu Huang, Jiangyi Yao
Source: IEEE Access, Vol 10, Pp 92410-92425 (2022)
Publisher Information: IEEE, 2022.
Publication Year: 2022
Collection: LCC:Electrical engineering. Electronics. Nuclear engineering
Subject Terms: End-to-end infrared and visible image fusion, contrast attention module, contour loss, target-guided reward function, Electrical engineering. Electronics. Nuclear engineering, TK1-9971
More Details: Infrared and visible image fusion combine data information from different sensors to achieve a richer description of the same scene. In order to highlight the salient features of the infrared image and the visible image in the fusion image and obtain a fusion image with good performance, an end-to-end infrared and visible image fusion algorithm is proposed in this paper. The contrast attention module and visible image cascade part are introduced in the generator, so that the fusion image can focus on the detail information in the visible image and the contrast information in the infrared image. And in order to retain more structural contour information in the original image, the contour loss is added to the content loss function. In addition, the contrast and detail information in infrared and visible images are balanced by two discriminators. And a goal-guided reward function is introduced into the discriminator, which further facilitates the generator to produce effective fused images. Finally, extensive fusion experiments on public datasets verify the advantages of the proposed algorithm compared with other classical algorithms, and ablation experiments demonstrate the effectiveness of the improved part of the algorithm.
Document Type: article
File Description: electronic resource
Language: English
ISSN: 2169-3536
Relation: https://ieeexplore.ieee.org/document/9869825/; https://doaj.org/toc/2169-3536
DOI: 10.1109/ACCESS.2022.3202974
Access URL: https://doaj.org/article/9a7c5fdb9e894f3cab9d13342bf0f81c
Accession Number: edsdoj.9a7c5fdb9e894f3cab9d13342bf0f81c
Database: Directory of Open Access Journals
More Details
ISSN:21693536
DOI:10.1109/ACCESS.2022.3202974
Published in:IEEE Access
Language:English