论文标题
提前了解深度质量:RGB-D显着对象检测的深度质量评估方法
Knowing Depth Quality In Advance: A Depth Quality Assessment Method For RGB-D Salient Object Detection
论文作者
论文摘要
先前的RGB-D显着对象检测(SOD)方法已广泛采用深度学习工具,以自动进行RGB和D(深度)之间的权衡,其关键理由是充分利用其互补性,旨在比仅使用任何一个使用任何一个。但是,这样的全自动融合可能并不总是有助于SOD任务,因为D质量本身通常会因场景而异。如果事先考虑D质量,它可能很容易导致次优融合结果。此外,作为一个客观的因素,长期以来的工作已被先前的工作忽略了。结果,它已成为明确的性能瓶颈。因此,我们提出了一个简单而有效的方案,以预先测量D质量,其关键思想是根据高质量D区域的常见属性来设计一系列特征。为了更具体,我们遵循包括低级边缘一致性,中级区域不确定性和高级模型方差的多尺度方法,对每个图像区域进行D质量评估。所有这些组件将独立计算,然后用RGB和D特征组装为隐式指标,以指导选择性融合。与最先进的融合方案相比,我们的方法可以在RGB和D之间达到更合理的融合状态。具体来说,所提出的D质量测量方法可以实现几乎2.0 \%的稳定绩效提高。
Previous RGB-D salient object detection (SOD) methods have widely adopted deep learning tools to automatically strike a trade-off between RGB and D (depth), whose key rationale is to take full advantage of their complementary nature, aiming for a much-improved SOD performance than that of using either of them solely. However, such fully automatic fusions may not always be helpful for the SOD task because the D quality itself usually varies from scene to scene. It may easily lead to a suboptimal fusion result if the D quality is not considered beforehand. Moreover, as an objective factor, the D quality has long been overlooked by previous work. As a result, it is becoming a clear performance bottleneck. Thus, we propose a simple yet effective scheme to measure D quality in advance, the key idea of which is to devise a series of features in accordance with the common attributes of high-quality D regions. To be more concrete, we conduct D quality assessments for each image region, following a multi-scale methodology that includes low-level edge consistency, mid-level regional uncertainty and high-level model variance. All these components will be computed independently and then be assembled with RGB and D features, applied as implicit indicators, to guide the selective fusion. Compared with the state-of-the-art fusion schemes, our method can achieve a more reasonable fusion status between RGB and D. Specifically, the proposed D quality measurement method achieves steady performance improvements for almost 2.0\% in general.