论文标题
通过实时用户点击和不确定性估计改进的图像垫
Improved Image Matting via Real-time User Clicks and Uncertainty Estimation
论文作者
论文摘要
图像垫是计算机视觉和图形中的一个基本且具有挑战性的问题。大多数现有的均值方法都利用用户提供的内饰作为辅助输入来产生良好的alpha哑光。但是,获得高质量的构图本身是艰巨的,因此限制了这些方法的应用。最近,一些不含Trimap的方法已经出现了,但是,底漆质量仍然远远落后于基于Trimap的方法。主要原因是,在某些情况下,如果没有TRIMAP指导,目标网络对哪个是前景目标的模棱两可。实际上,选择前景是一个主观过程,取决于用户的意图。为此,本文提出了一个改进的深层图像垫框架,该框架无需三板,并且只需要几个用户点击交互即可消除歧义。此外,我们引入了一个新的不确定性估计模块,该模块可以预测哪些部分需要抛光和以下局部细化模块。根据计算预算,用户可以选择通过不确定性指导来改善多少本地零件。定量和定性结果表明,我们的方法的性能优于现有的不含Trimap的方法,并且与最小的用户努力相比,基于最新的Trimap方法相当。
Image matting is a fundamental and challenging problem in computer vision and graphics. Most existing matting methods leverage a user-supplied trimap as an auxiliary input to produce good alpha matte. However, obtaining high-quality trimap itself is arduous, thus restricting the application of these methods. Recently, some trimap-free methods have emerged, however, the matting quality is still far behind the trimap-based methods. The main reason is that, without the trimap guidance in some cases, the target network is ambiguous about which is the foreground target. In fact, choosing the foreground is a subjective procedure and depends on the user's intention. To this end, this paper proposes an improved deep image matting framework which is trimap-free and only needs several user click interactions to eliminate the ambiguity. Moreover, we introduce a new uncertainty estimation module that can predict which parts need polishing and a following local refinement module. Based on the computation budget, users can choose how many local parts to improve with the uncertainty guidance. Quantitative and qualitative results show that our method performs better than existing trimap-free methods and comparably to state-of-the-art trimap-based methods with minimal user effort.