论文标题

通过共同的丰富空间进行高光谱图像分类的物理约束转移学习

Physically-Constrained Transfer Learning through Shared Abundance Space for Hyperspectral Image Classification

论文作者

Qu, Ying, Baghbaderani, Razieh Kaviani, Li, Wei, Gao, Lianru, Qi, Hairong

论文摘要

高光谱图像(HSI)分类是最活跃的研究主题之一,并且通过最新的深度学习发展获得了有希望的结果。但是,当训练和测试图像分别在不同的域上,例如源域和目标域,由于不同采集条件引起的频谱变异性,大多数最新方法的性能往往较差。基于转移学习的方法通过在源域中预训练并在目标域上进行微调来解决此问题。但是,必须标记有关目标域的大量数据,并且需要不可忽略的计算资源才能重新训练整个网络。在本文中,我们提出了一种新的转移学习方案,以通过将HSI数据从源和目标域投射到基于其自身的物理特征中的共享丰度空间中来弥合源和目标域之间的差距。这样,将大大减少域差异,以便可以在源域上训练的模型无需额外的数据标记或网络再培训而应用于目标域。所提出的方法通过共享丰度空间(PCTL-SAS)称为物理约束的转移学习。与最先进的实验结果相比,广泛的实验结果表明了所提出的方法的优越性。这项努力的成功将在很大程度上促进HSI分类用于现实传感方案。

Hyperspectral image (HSI) classification is one of the most active research topics and has achieved promising results boosted by the recent development of deep learning. However, most state-of-the-art approaches tend to perform poorly when the training and testing images are on different domains, e.g., source domain and target domain, respectively, due to the spectral variability caused by different acquisition conditions. Transfer learning-based methods address this problem by pre-training in the source domain and fine-tuning on the target domain. Nonetheless, a considerable amount of data on the target domain has to be labeled and non-negligible computational resources are required to retrain the whole network. In this paper, we propose a new transfer learning scheme to bridge the gap between the source and target domains by projecting the HSI data from the source and target domains into a shared abundance space based on their own physical characteristics. In this way, the domain discrepancy would be largely reduced such that the model trained on the source domain could be applied on the target domain without extra efforts for data labeling or network retraining. The proposed method is referred to as physically-constrained transfer learning through shared abundance space (PCTL-SAS). Extensive experimental results demonstrate the superiority of the proposed method as compared to the state-of-the-art. The success of this endeavor would largely facilitate the deployment of HSI classification for real-world sensing scenarios.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源