论文标题
自主驾驶中的图像和点云融合的深度学习:评论
Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review
论文作者
论文摘要
在过去的几年中,自动驾驶汽车正在迅速发展。但是,由于复杂而动态的驾驶环境的性质,实现完全自主权并不是一项琐碎的任务。因此,自动驾驶汽车配备了一套不同的传感器,以确保稳健,准确的环境感知。特别是,摄像头融合正成为新兴的研究主题。但是,到目前为止,还没有关注基于深度学习的摄像头融合方法的关键评论。为了弥合这一差距并激发未来的研究,本文致力于回顾最新的基于研究的数据融合方法,以利用图像和点云。这篇评论简要概述了对图像和点云数据处理的深入学习。然后对摄像机范围融合方法进行深入审查深入完成,对象检测,语义分割,跟踪和在线跨传感器校准,这些校准是根据它们各自的融合水平组织的。此外,我们在公开可用的数据集上比较了这些方法。最后,我们确定了当前学术研究和现实世界应用之间的差距和挑战。基于这些观察,我们提供了见解,并指出了有前途的研究方向。
Autonomous vehicles were experiencing rapid development in the past few years. However, achieving full autonomy is not a trivial task, due to the nature of the complex and dynamic driving environment. Therefore, autonomous vehicles are equipped with a suite of different sensors to ensure robust, accurate environmental perception. In particular, the camera-LiDAR fusion is becoming an emerging research theme. However, so far there has been no critical review that focuses on deep-learning-based camera-LiDAR fusion methods. To bridge this gap and motivate future research, this paper devotes to review recent deep-learning-based data fusion approaches that leverage both image and point cloud. This review gives a brief overview of deep learning on image and point cloud data processing. Followed by in-depth reviews of camera-LiDAR fusion methods in depth completion, object detection, semantic segmentation, tracking and online cross-sensor calibration, which are organized based on their respective fusion levels. Furthermore, we compare these methods on publicly available datasets. Finally, we identified gaps and over-looked challenges between current academic researches and real-world applications. Based on these observations, we provide our insights and point out promising research directions.