论文标题
精细分辨率遥感图像的语义分割的多发项网络
Multi-Attention-Network for Semantic Segmentation of Fine Resolution Remote Sensing Images
论文作者
论文摘要
遥感图像的语义分割在包括土地资源管理,生物圈监测和城市规划在内的广泛应用中起着重要作用。尽管深层卷积神经网络在遥感图像中的语义分割的准确性显着提高了,但标准模型中存在一些局限性。首先,对于诸如U-NET之类的编码器架构,多尺度功能的利用会导致信息不足,其中低级功能和高级特征直接被直接串联而没有任何细化。其次,特征图的远程依赖性不足以探索,从而导致与每个语义类相关的次优特征表示。第三,即使在语义分段中引入和利用了点产物的注意机制来对远程依赖性进行建模,但注意力的巨大时间和空间需求仍阻碍了在具有大规模输入的应用程序场景中实际使用的注意力。本文提出了一个多发网络(MANET),通过通过多种有效的注意模块提取上下文依赖性来解决这些问题。提出了一种具有线性复杂性的内核注意力的新型注意机制,以减轻注意力的巨大计算需求。基于内核注意力和通道注意,我们将Resnext-101提取的局部特征图与它们相应的全局依赖性和重量相互依存的通道映射自适应地整合在一起。在三个大尺度细分辨率遥感图像上进行的数值实验表明,提出的MANET的表现优于DeepLab V3+,PSPNET,FastFCN,Danet,Ocrnet和其他基准方法。
Semantic segmentation of remote sensing images plays an important role in a wide range of applications including land resource management, biosphere monitoring and urban planning. Although the accuracy of semantic segmentation in remote sensing images has been increased significantly by deep convolutional neural networks, several limitations exist in standard models. First, for encoder-decoder architectures such as U-Net, the utilization of multi-scale features causes the underuse of information, where low-level features and high-level features are concatenated directly without any refinement. Second, long-range dependencies of feature maps are insufficiently explored, resulting in sub-optimal feature representations associated with each semantic class. Third, even though the dot-product attention mechanism has been introduced and utilized in semantic segmentation to model long-range dependencies, the large time and space demands of attention impede the actual usage of attention in application scenarios with large-scale input. This paper proposed a Multi-Attention-Network (MANet) to address these issues by extracting contextual dependencies through multiple efficient attention modules. A novel attention mechanism of kernel attention with linear complexity is proposed to alleviate the large computational demand in attention. Based on kernel attention and channel attention, we integrate local feature maps extracted by ResNeXt-101 with their corresponding global dependencies and reweight interdependent channel maps adaptively. Numerical experiments on three large-scale fine resolution remote sensing images captured by different satellite sensors demonstrate the superior performance of the proposed MANet, outperforming the DeepLab V3+, PSPNet, FastFCN, DANet, OCRNet, and other benchmark approaches.