论文标题

在动态室内环境中,通过空间分区的空间分区进行稳健的神经路线

Robust Neural Routing Through Space Partitions for Camera Relocalization in Dynamic Indoor Environments

论文作者

Dong, Siyan, Fan, Qingnan, Wang, He, Shi, Ji, Yi, Li, Funkhouser, Thomas, Chen, Baoquan, Guibas, Leonidas

论文摘要

将相机定位在已知的室内环境中是一个关键的构图,用于场景映射,机器人导航,AR等。最近的进步通过在2D/3D摄像机空间和3D世界空间之间建立的2D/3D-3D对应关系上的优化估计相机姿势。仅使用静态输入图像序列,用卷积神经网络或决策树估算了这样的映射,这使得这些方法容易受到动态室内环境的影响,这些方法在现实世界中既普遍又具有挑战性。为了解决上述问题,在本文中,我们提出了一种新颖的异常感知神经树,它弥合了两个世界,深度学习和决策树的方法。它建立在三个重要区块上:(a)室内场景上的分层空间分区以构建决策树; (b)作为深层分类网络实现的神经路由功能,用于更好地理解3D场景; (c)用于在层次路由过程中滤除动态点的异常拒绝模块。我们提出的算法对在动态室内环境中开发的RIO-10基准进行了评估。它通过空间分区实现了强大的神经路由,并在相机姿势的准确性上优于最先进的方法,同时运行速度相当快以进行评估。

Localizing the camera in a known indoor environment is a key building block for scene mapping, robot navigation, AR, etc. Recent advances estimate the camera pose via optimization over the 2D/3D-3D correspondences established between the coordinates in 2D/3D camera space and 3D world space. Such a mapping is estimated with either a convolution neural network or a decision tree using only the static input image sequence, which makes these approaches vulnerable to dynamic indoor environments that are quite common yet challenging in the real world. To address the aforementioned issues, in this paper, we propose a novel outlier-aware neural tree which bridges the two worlds, deep learning and decision tree approaches. It builds on three important blocks: (a) a hierarchical space partition over the indoor scene to construct the decision tree; (b) a neural routing function, implemented as a deep classification network, employed for better 3D scene understanding; and (c) an outlier rejection module used to filter out dynamic points during the hierarchical routing process. Our proposed algorithm is evaluated on the RIO-10 benchmark developed for camera relocalization in dynamic indoor environments. It achieves robust neural routing through space partitions and outperforms the state-of-the-art approaches by around 30% on camera pose accuracy, while running comparably fast for evaluation.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源