论文标题

在6个自由度下朝着网格显着检测

Towards Mesh Saliency Detection in 6 Degrees of Freedom

论文作者

Ding, Xiaoying, Chen, Zhenzhong

论文摘要

传统的3D网格显着检测算法和相应的数据库是在几个约束下提出的,例如提供有限的观看方向,而不考虑受试者的运动。在这项工作中,开发了一个新颖的6DOF网格显着数据库,该数据库提供了受试者的6DOF数据和眼动数据。与传统数据库不同,实验中的受试者可以自由移动以在虚拟现实环境中观察3D网格。基于数据库,我们首先分析观察者间的变化以及对受试者视觉注意力的观察方向的影响,然后我们提供了有关受试者在观察过程中的视觉注意力偏见的进一步研究。此外,我们提出了一种基于唯一性度量和偏置偏好的6DOF网格显着性检测算法。为了评估所提出的方法,我们还相应地设计了一个评估度量,该指标会考虑6DOF信息,并扩展了一些最新的3D显着性检测方法以进行比较。实验结果表明,除了为提出的6DOF网格显着数据库提供基准外,我们的6DOF网格显着性检测方法的出色表现。数据库和相应的算法将公开用于研究目的。

Traditional 3D mesh saliency detection algorithms and corresponding databases were proposed under several constraints such as providing limited viewing directions and not taking the subject's movement into consideration. In this work, a novel 6DoF mesh saliency database is developed which provides both the subject's 6DoF data and eye-movement data. Different from traditional databases, subjects in the experiment are allowed to move freely to observe 3D meshes in a virtual reality environment. Based on the database, we first analyze the inter-observer variation and the influence of viewing direction towards subject's visual attention, then we provide further investigations about the subject's visual attention bias during observation. Furthermore, we propose a 6DoF mesh saliency detection algorithm based on the uniqueness measure and the bias preference. To evaluate the proposed approach, we also design an evaluation metric accordingly which takes the 6DoF information into consideration, and extend some state-of-the-art 3D saliency detection methods to make comparisons. The experimental results demonstrate the superior performance of our approach for 6DoF mesh saliency detection, in addition to providing benchmarks for the presented 6DoF mesh saliency database. The database and the corresponding algorithms will be made publicly available for research purposes.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源