论文标题
关于标签有效的深层图像分割的调查:弥合弱监督和密集预测之间的差距
A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Prediction
论文作者
论文摘要
深度学习的快速发展在图像细分方面取得了长足的进步,这是计算机视觉的基本任务之一。但是,当前的细分算法主要取决于像素级注释的可用性,这些注释通常昂贵,乏味且费力。为了减轻这一负担,过去几年目睹了越来越多的关注,这是建立标签高效的,基于深度学习的图像细分算法。本文对标签有效的图像分割方法进行了全面的审查。为此,我们首先根据不同类型的弱标签提供的监督(包括没有监督,不确定的监督,不完整的监督和不准确的监督)来组织这些方法,并通过细分问题的类型(包括语义细分,实例分段,分段和papoptic分割)进行补充。接下来,我们从统一的角度总结了现有的标签效率图像分割方法,该方法讨论了一个重要的问题:如何弥合弱监督和密集预测之间的差距 - 当前方法主要基于启发式先知,例如跨像素相似性,交叉式约束,交叉浏览,交叉观察一致性,以及交叉 - 图。最后,我们分享了关于标签有效的深层图像细分的未来研究方向的看法。
The rapid development of deep learning has made a great progress in image segmentation, one of the fundamental tasks of computer vision. However, the current segmentation algorithms mostly rely on the availability of pixel-level annotations, which are often expensive, tedious, and laborious. To alleviate this burden, the past years have witnessed an increasing attention in building label-efficient, deep-learning-based image segmentation algorithms. This paper offers a comprehensive review on label-efficient image segmentation methods. To this end, we first develop a taxonomy to organize these methods according to the supervision provided by different types of weak labels (including no supervision, inexact supervision, incomplete supervision and inaccurate supervision) and supplemented by the types of segmentation problems (including semantic segmentation, instance segmentation and panoptic segmentation). Next, we summarize the existing label-efficient image segmentation methods from a unified perspective that discusses an important question: how to bridge the gap between weak supervision and dense prediction -- the current methods are mostly based on heuristic priors, such as cross-pixel similarity, cross-label constraint, cross-view consistency, and cross-image relation. Finally, we share our opinions about the future research directions for label-efficient deep image segmentation.