论文标题
使用条件gan具有结构边缘的损伤区域进行分割的合成图像增强
Synthetic Image Augmentation for Damage Region Segmentation using Conditional GAN with Structure Edge
论文作者
论文摘要
最近,社会基础设施正在老化,其预测性维护已成为重要的问题。为了监视基础设施的状态,桥梁检查由人眼或湾无人机进行。为了诊断,为维修目标确认了主要损害区域。但是,较差的水平下降很少发生,感兴趣的损害区域通常很狭窄,因此其每个图像的比例为极小的像素计数,而经验丰富的0.6%至1.5%。感兴趣的损害区域的稀缺性和不平衡性能都会影响有限的性能以检测损害。如果可以生成损坏的图像的其他数据集,则可以提高损坏区域分割算法的准确性。我们提出了一个合成的增强程序,使用来自三类类别标签的图像到图像翻译映射生成损坏的图像,该标签既包括语义标签和结构边缘,又是真实损坏图像。我们使用SOBEL梯度操作员来增强结构边缘。实际上,在进行桥梁检查的情况下,我们应用了RC混凝土结构,其中有208张注视照片的照片,这些照片已经发生了,这些照片已经准备好了840个块图像,其尺寸为224 x 224。我们应用了流行的人均分段分段算法,例如FCN-8S,SEGNET,SEGNET和DEEPLABV3+XCECTION-XCECTION-V2。我们证明,重新培训用合成增强程序添加的数据集可根据索引提高准确性,而当我们预测测试图像时,均值,损害区域ioU,精度,召回,bf得分。
Recently, social infrastructure is aging, and its predictive maintenance has become important issue. To monitor the state of infrastructures, bridge inspection is performed by human eye or bay drone. For diagnosis, primary damage region are recognized for repair targets. But, the degradation at worse level has rarely occurred, and the damage regions of interest are often narrow, so their ratio per image is extremely small pixel count, as experienced 0.6 to 1.5 percent. The both scarcity and imbalance property on the damage region of interest influences limited performance to detect damage. If additional data set of damaged images can be generated, it may enable to improve accuracy in damage region segmentation algorithm. We propose a synthetic augmentation procedure to generate damaged images using the image-to-image translation mapping from the tri-categorical label that consists the both semantic label and structure edge to the real damage image. We use the Sobel gradient operator to enhance structure edge. Actually, in case of bridge inspection, we apply the RC concrete structure with the number of 208 eye-inspection photos that rebar exposure have occurred, which are prepared 840 block images with size 224 by 224. We applied popular per-pixel segmentation algorithms such as the FCN-8s, SegNet, and DeepLabv3+Xception-v2. We demonstrates that re-training a data set added with synthetic augmentation procedure make higher accuracy based on indices the mean IoU, damage region of interest IoU, precision, recall, BF score when we predict test images.