论文标题

使用生成模型恢复压缩图像以进行自动裂纹分割

Recovering compressed images for automatic crack segmentation using generative models

论文作者

Huang, Yong, Zhang, Haoyu, Li, Hui, Wu, Stephen

论文摘要

在使用数码相机监测结构表面裂纹的结构健康监测(SHM)系统中,可靠且有效的数据压缩技术对于确保无线设备中的稳定且节能的裂纹图像传输至关重要,例如无人机和机器人,具有高清晰度摄像头的安装。压缩传感(CS)是一种信号处理技术,它允许从采样率中准确恢复信号,远小于Nyquist采样定理的限制。常规的CS方法基于以下原理:通过正规化优化,可以利用某些域中原始信号的稀疏性属性,以具有高概率的确切重建。但是,对于真实的裂纹图像,信号在可逆空间中高度稀疏的强烈假设相对较难。在本文中,我们提出了一种新的CS方法,该方法用生成模型替代了稀疏性正则化,该模型能够有效捕获目标图像的低维表示。我们开发了一个基于这种新CS方法的压缩裂纹图像的自动破解框架的恢复框架,并证明了该方法的显着性能,利用了生成模型的强大能力来捕获裂纹分割任务中所需的必要功能,即使生成图像的背景也无法很好地重构。通过与现有的三种CS算法进行比较来说明我们的恢复框架的出色性能。此外,我们表明我们的框架可以扩展到自动裂纹分割中其他常见问题,例如从运动模糊和遮挡中恢复缺陷。

In a structural health monitoring (SHM) system that uses digital cameras to monitor cracks of structural surfaces, techniques for reliable and effective data compression are essential to ensure a stable and energy efficient crack images transmission in wireless devices, e.g., drones and robots with high definition cameras installed. Compressive sensing (CS) is a signal processing technique that allows accurate recovery of a signal from a sampling rate much smaller than the limitation of the Nyquist sampling theorem. The conventional CS method is based on the principle that, through a regularized optimization, the sparsity property of the original signals in some domain can be exploited to get the exact reconstruction with a high probability. However, the strong assumption of the signals being highly sparse in an invertible space is relatively hard for real crack images. In this paper, we present a new approach of CS that replaces the sparsity regularization with a generative model that is able to effectively capture a low dimension representation of targeted images. We develop a recovery framework for automatic crack segmentation of compressed crack images based on this new CS method and demonstrate the remarkable performance of the method taking advantage of the strong capability of generative models to capture the necessary features required in the crack segmentation task even the backgrounds of the generated images are not well reconstructed. The superior performance of our recovery framework is illustrated by comparing with three existing CS algorithms. Furthermore, we show that our framework is extensible to other common problems in automatic crack segmentation, such as defect recovery from motion blurring and occlusion.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源