论文标题
从水下图像中去除海底不变性的焦点
Seafloor-Invariant Caustics Removal from Underwater Imagery
论文作者
论文摘要
用水下成像摄像机绘制海底,对于包括海洋工程,地质学,地质学,考古学和生物学在内的各种应用至关重要。对于浅水,在水下成像挑战中,苛性水域,即由波浪状表面折射的光射线的投射而产生的复杂物理现象,这可能是最关键的物理现象。苛性碱是在水下成像运动中的主要因素,这些因素大大降低了图像质量并严重影响海床的任何2D摩西或3D重建。在这项工作中,我们提出了一种新的方法,用于纠正苛性剂对浅水水下图像的辐射效果。与最先进的方法相反,开发的方法可以处理任何疾病的海床和河床,并使用真实像素信息校正图像,从而改善图像匹配和3D重建过程。特别是,开发的方法采用深度学习体系结构,以将图像像素分类为“非杀伤力”和“苛刻”。然后,利用场景的3D几何形状,通过在重叠的水下图像之间传输适当的颜色值来实现像素校正。此外,为了填补当前空白,我们已经收集,注释和构建了一个现实世界中的苛性数据集,即公开可用的R-Caustic。总体而言,根据实验结果和验证,开发的方法在检测苛性剂和重建其强度方面非常有前途。
Mapping the seafloor with underwater imaging cameras is of significant importance for various applications including marine engineering, geology, geomorphology, archaeology and biology. For shallow waters, among the underwater imaging challenges, caustics i.e., the complex physical phenomena resulting from the projection of light rays being refracted by the wavy surface, is likely the most crucial one. Caustics is the main factor during underwater imaging campaigns that massively degrade image quality and affect severely any 2D mosaicking or 3D reconstruction of the seabed. In this work, we propose a novel method for correcting the radiometric effects of caustics on shallow underwater imagery. Contrary to the state-of-the-art, the developed method can handle seabed and riverbed of any anaglyph, correcting the images using real pixel information, thus, improving image matching and 3D reconstruction processes. In particular, the developed method employs deep learning architectures in order to classify image pixels to "non-caustics" and "caustics". Then, exploits the 3D geometry of the scene to achieve a pixel-wise correction, by transferring appropriate color values between the overlapping underwater images. Moreover, to fill the current gap, we have collected, annotated and structured a real-world caustic dataset, namely R-CAUSTIC, which is openly available. Overall, based on the experimental results and validation the developed methodology is quite promising in both detecting caustics and reconstructing their intensity.