论文标题

深度半监督视觉识别的密度感知图

Density-Aware Graph for Deep Semi-Supervised Visual Recognition

论文作者

Li, Suichan, Liu, Bin, Chen, Dongdong, Chu, Qi, Yuan, Lu, Yu, Nenghai

论文摘要

半监督学习(SSL)已进行了广泛的研究,以提高深层神经网络的视觉识别能力。为了涉及未标记的数据,大多数现有的SSL方法基于基于通用密度的集群假设:位于同一高密度区域中的样品可能属于同一类,包括执行一致性正则化的方法或为未标记图像生成伪标签。尽管其表现令人印象深刻,但我们认为存在三个局限性:1)尽管密度信息被证明是一个重要的线索,但它们都以隐式的方式使用它,并且没有深入探索它。 2)对于特征学习,他们经常根据单个数据样本学习嵌入功能,并忽略邻里信息。 3)对于基于标签 - pseudo-label的生成,通常是离线完成的,很难通过功能学习端到端培训。在这些局限性的推动下,本文提议通过构建一种新颖的密度感知图来解决SSL问题,基于该图,可以轻松利用邻里信息,并且功能学习和标签传播也可以以端到端的方式进行培训。具体而言,我们首先提出了一种新的密度感知邻域聚集(DNA)模块,以通过以密度感知方式合并邻里信息来学习更多的判别特征。然后提出了一个新型的基于密度的基于路径的标签传播(DPLP)模块,以根据密度为特征的特征分布更有效地生成未标记样品的伪标记。最后,DNA模块和DPLP模块端到端相互发展并相互改进。

Semi-supervised learning (SSL) has been extensively studied to improve the generalization ability of deep neural networks for visual recognition. To involve the unlabelled data, most existing SSL methods are based on common density-based cluster assumption: samples lying in the same high-density region are likely to belong to the same class, including the methods performing consistency regularization or generating pseudo-labels for the unlabelled images. Despite their impressive performance, we argue three limitations exist: 1) Though the density information is demonstrated to be an important clue, they all use it in an implicit way and have not exploited it in depth. 2) For feature learning, they often learn the feature embedding based on the single data sample and ignore the neighborhood information. 3) For label-propagation based pseudo-label generation, it is often done offline and difficult to be end-to-end trained with feature learning. Motivated by these limitations, this paper proposes to solve the SSL problem by building a novel density-aware graph, based on which the neighborhood information can be easily leveraged and the feature learning and label propagation can also be trained in an end-to-end way. Specifically, we first propose a new Density-aware Neighborhood Aggregation(DNA) module to learn more discriminative features by incorporating the neighborhood information in a density-aware manner. Then a novel Density-ascending Path based Label Propagation(DPLP) module is proposed to generate the pseudo-labels for unlabeled samples more efficiently according to the feature distribution characterized by density. Finally, the DNA module and DPLP module evolve and improve each other end-to-end.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源