论文标题

综合边界:一个弱监督的显着对象检测的边界意识的自洽框架

Synthesize Boundaries: A Boundary-aware Self-consistent Framework for Weakly Supervised Salient Object Detection

论文作者

Xu, Binwei, Liang, Haoran, Liang, Ronghua, Chen, Peng

论文摘要

完全监督的显着对象检测(SOD)基于昂贵且耗时的数据,并带有像素的注释,取得了长足的进步。最近,为了减轻标签负担,同时还提出了一些基于涂鸦的SOD方法。但是,从缺乏边缘信息的涂鸦注释中学习精确的边界细节仍然很困难。在本文中,我们建议从设计的合成图像和标签中学习精确的边界,而无需引入任何额外的辅助数据。合成图像通过插入模拟显着对象的真实凹点的合成凹形区域来创建边界信息。此外,我们提出了一个新型的自洽框架,该框架由全球整体分支(GIB)和一个边界感知分支(BAB)组成,以训练显着性检测器。 GIB旨在识别积分显着对象,其输入是原始图像。 BAB旨在帮助预测准确的边界,其输入是合成图像。这两个分支是通过自一致的损失连接的,以指导显着性检测器在识别显着对象的同时预测精确的边界。五个基准的实验结果表明,我们的方法的表现优于最新的弱监督SOD方法,并通过完全监督的方法进一步缩小了差距。

Fully supervised salient object detection (SOD) has made considerable progress based on expensive and time-consuming data with pixel-wise annotations. Recently, to relieve the labeling burden while maintaining performance, some scribble-based SOD methods have been proposed. However, learning precise boundary details from scribble annotations that lack edge information is still difficult. In this paper, we propose to learn precise boundaries from our designed synthetic images and labels without introducing any extra auxiliary data. The synthetic image creates boundary information by inserting synthetic concave regions that simulate the real concave regions of salient objects. Furthermore, we propose a novel self-consistent framework that consists of a global integral branch (GIB) and a boundary-aware branch (BAB) to train a saliency detector. GIB aims to identify integral salient objects, whose input is the original image. BAB aims to help predict accurate boundaries, whose input is the synthetic image. These two branches are connected through a self-consistent loss to guide the saliency detector to predict precise boundaries while identifying salient objects. Experimental results on five benchmarks demonstrate that our method outperforms the state-of-the-art weakly supervised SOD methods and further narrows the gap with the fully supervised methods.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源