论文标题

DNSWIN:通过连续的小波滑动转换器迈向现实世界

DnSwin: Toward Real-World Denoising via Continuous Wavelet Sliding-Transformer

论文作者

Li, Hao, Yang, Zhijing, Hong, Xiaobin, Zhao, Ziying, Chen, Junyang, Shi, Yukai, Pan, Jinshan

论文摘要

现实世界图像Denoising是一个实用的图像恢复问题,旨在从野外嘈杂的输入中获取干净的图像。最近,视觉变压器(VIT)表现出强大的捕获远程依赖性的能力,许多研究人员试图将VIT应用于图像DeNosing任务。但是,现实世界的图像是一个孤立的框架,它使VIT基于内部贴片构建长距离依赖性,该贴片将图像分为贴片,混乱噪声模式并损坏梯度连续性。在本文中,我们建议通过使用连续的小波滑动转换器来解决此问题,该电波转换器在现实世界中构建频率对应关系,称为DNSWIN。具体而言,我们首先使用卷积神经网络(CNN)编码器从嘈杂的输入图像中提取底部特征。 DNSWIN的关键是从观察到的功能和构建频率依赖性中提取高频和低频信息。为此,我们提出了一个小波滑动窗口变压器(WSWT),该变压器(WSWT)利用离散小波变换(DWT),自我注意力和逆DWT(IDWT)来提取深度特征。最后,我们使用CNN解码器将深度特征重构为DeNo的图像。对现实世界的基准进行的定量和定性评估都表明,所提出的DNSWIN对最新方法的表现有利。

Real-world image denoising is a practical image restoration problem that aims to obtain clean images from in-the-wild noisy inputs. Recently, the Vision Transformer (ViT) has exhibited a strong ability to capture long-range dependencies, and many researchers have attempted to apply the ViT to image denoising tasks. However, a real-world image is an isolated frame that makes the ViT build long-range dependencies based on the internal patches, which divides images into patches, disarranges noise patterns and damages gradient continuity. In this article, we propose to resolve this issue by using a continuous Wavelet Sliding-Transformer that builds frequency correspondences under real-world scenes, called DnSwin. Specifically, we first extract the bottom features from noisy input images by using a convolutional neural network (CNN) encoder. The key to DnSwin is to extract high-frequency and low-frequency information from the observed features and build frequency dependencies. To this end, we propose a Wavelet Sliding-Window Transformer (WSWT) that utilizes the discrete wavelet transform (DWT), self-attention and the inverse DWT (IDWT) to extract deep features. Finally, we reconstruct the deep features into denoised images using a CNN decoder. Both quantitative and qualitative evaluations conducted on real-world denoising benchmarks demonstrate that the proposed DnSwin performs favorably against the state-of-the-art methods.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源