论文标题

跟踪人体内部的单眼摄像头姿势和变形

Tracking monocular camera pose and deformation for SLAM inside the human body

论文作者

Rodriguez, Juan J. Gomez, Montiel, J. M. M, Tardos, Juan D.

论文摘要

在可变形场景中,单眼大满贯将为多个医疗应用开辟道路,例如内窥镜检查,自动药物输送或自动机器人手术的计算机辅助导航。在本文中,我们提出了一种新颖的方法,可以同时跟踪相机姿势和3D场景变形,而没有任何关于环境拓扑或形状的假设。该方法使用一种照明不变的光度法来跟踪图像特征,并估算相机运动和变形,将再投影误差与空间和时间正则变形相结合。我们在模拟结肠镜检查中的结果表明,在不断提高的变形水平下,该方法在复杂场景中的鲁棒性。我们对内摩轴数据集的人类结肠镜检查的定性结果表明,该方法能够成功应对真实内窥镜的挑战:变形,质地低和强烈的照明变化。我们还将在Hamlyn数据集的更简单方案中与以前的跟踪方法进行比较,在那里我们获得了竞争性能,而无需任何拓扑假设。

Monocular SLAM in deformable scenes will open the way to multiple medical applications like computer-assisted navigation in endoscopy, automatic drug delivery or autonomous robotic surgery. In this paper we propose a novel method to simultaneously track the camera pose and the 3D scene deformation, without any assumption about environment topology or shape. The method uses an illumination-invariant photometric method to track image features and estimates camera motion and deformation combining reprojection error with spatial and temporal regularization of deformations. Our results in simulated colonoscopies show the method's accuracy and robustness in complex scenes under increasing levels of deformation. Our qualitative results in human colonoscopies from Endomapper dataset show that the method is able to successfully cope with the challenges of real endoscopies: deformations, low texture and strong illumination changes. We also compare with previous tracking methods in simpler scenarios from Hamlyn dataset where we obtain competitive performance, without needing any topological assumption.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源