Image inpainting based on tensor ring decomposition with generative adversarial network.

Bibliographic Details
Title: Image inpainting based on tensor ring decomposition with generative adversarial network.
Authors: Yuan, Jianjun, Wu, Hong, Zhao, Luoming, Wu, Fujun
Source: Signal, Image & Video Processing; Nov2024, Vol. 18 Issue 11, p7621-7634, 14p
Abstract: Image inpainting is a fundamental task in the field of computer vision. However, there are three major challenges associated with this technique: (1) maintaining neighborhood texture consistency; (2) ensuring the rationality of visual structure; and (3) the limitation of existing inpainting models based on deep neural networks due to a large number of parameters. In order to tackle these challenges, we propose a novel generative adversarial network based on tensor ring decomposition to inpaint images with varying degrees of damage. First, we design a dual-path block that captures features at different scales without significant memory consumption. Every pair of dual-path blocks is incorporated into an enhanced residual module to integrate local and global features. Additionally, we propose the tensor ring layer to compress the convolution, reducing the number of model parameters and computational complexity. We then use a more accurate U-Net based discriminator to optimize the network by minimizing reconstruction loss, adversarial loss, perceptual loss and style loss. Extensive experiments demonstrate that, when compared with other state-of-the-art algorithms, our model shows superior performance in compression. The repaired images also exhibit reasonable texture structure and contextual semantic information. [ABSTRACT FROM AUTHOR]
Copyright of Signal, Image & Video Processing is the property of Springer Nature and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Complementary Index
More Details
ISSN:18631703
DOI:10.1007/s11760-024-03415-7
Published in:Signal, Image & Video Processing
Language:English