论文标题

使用网络摄像头和人群图像监视湖冰块

Lake Ice Monitoring with Webcams and Crowd-Sourced Images

论文作者

Prabha, Rajanie, Tom, Manu, Rothermel, Mathias, Baltsavias, Emmanuel, Leal-Taixe, Laura, Schindler, Konrad

论文摘要

湖冰是一个强大的气候指标,已被全球气候观察系统(GCO)公认为是必需气候变量(ECV)的一部分。冰冻和解冻的动态以及随着时间的流逝的冰冻模式可能会改变,可以帮助理解本地和全球气候系统。获取有关独立于云的湖冰形成的时空信息的一种方法是分析网络摄像头图像。本文打算朝着使用免费的网络摄像头数据监视湖冰的通用模型。我们展示了良好的性能,包括具有跨不同冬季和不同湖泊的能力,具有针对语义图像分割的最先进的卷积神经网络(CNN)模型,DeepLab V3+。此外,我们设计了该模型的变体,称为Deep-U-LAB,该模型预测了更清晰,更正确的分割边界。我们已经测试了该模型使用来自多个相机视图和两个不同冬季的数据概括的能力。平均而言,它在不同的摄像机中达到约71%的交叉点(IOU)值约为71%,在不同的冬季中,〜69%的值〜69%,大大优于先前的工作。进一步进一步,我们表明该模型甚至可以在从照片共享网站上刮除的任意图像上获得60%的IOU。作为工作的一部分,我们介绍了来自多个摄像头和两个不同冬季的网络摄像头图像,Photi-Lake的新基准数据集,以及Pixel-Wise-Wise地面真相注释。

Lake ice is a strong climate indicator and has been recognised as part of the Essential Climate Variables (ECV) by the Global Climate Observing System (GCOS). The dynamics of freezing and thawing, and possible shifts of freezing patterns over time, can help in understanding the local and global climate systems. One way to acquire the spatio-temporal information about lake ice formation, independent of clouds, is to analyse webcam images. This paper intends to move towards a universal model for monitoring lake ice with freely available webcam data. We demonstrate good performance, including the ability to generalise across different winters and different lakes, with a state-of-the-art Convolutional Neural Network (CNN) model for semantic image segmentation, Deeplab v3+. Moreover, we design a variant of that model, termed Deep-U-Lab, which predicts sharper, more correct segmentation boundaries. We have tested the model's ability to generalise with data from multiple camera views and two different winters. On average, it achieves intersection-over-union (IoU) values of ~71% across different cameras and ~69% across different winters, greatly outperforming prior work. Going even further, we show that the model even achieves 60% IoU on arbitrary images scraped from photo-sharing web sites. As part of the work, we introduce a new benchmark dataset of webcam images, Photi-LakeIce, from multiple cameras and two different winters, along with pixel-wise ground truth annotations.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源