论文标题

细心的波形:互补性增强的相互网络,用于无监督的域名适应性及以后的适应性

Attentive WaveBlock: Complementarity-enhanced Mutual Networks for Unsupervised Domain Adaptation in Person Re-identification and Beyond

论文作者

Wang, Wenhao, Zhao, Fang, Liao, Shengcai, Shao, Ling

论文摘要

由于源和目标域之间存在巨大差距,因此对人员重新识别的无监督域适应性(UDA)具有挑战性。一种典型的自我训练方法是使用通过将算法聚集到目标域上的模型而生成的伪标记。但是,对此的缺点是嘈杂的伪标签通常会在学习中造成麻烦。为了解决这个问题,已经开发了一种通过双网络的相互学习方法来生成可靠的软标签。但是,随着两个神经网络逐渐汇聚,它们的互补性被削弱,它们可能会偏向同样的噪声。本文提出了一个新颖的轻量级模块,即细心的波形(AWB),可以将其集成到相互学习的双网络中,以增强伪标签中的互补性和进一步的降低噪声。具体而言,我们首先引入一个无参数的模块,即Waveblock,该模块通过以不同的方式挥动特征映射的块来造成两个网络所学的特征之间的差异。然后,利用注意力机制来扩大所产生的差异并发现更多互补特征。此外,还探讨了两种组合策略,即注意前和注意。实验表明,所提出的方法实现了最先进的绩效,对多个UDA人重新识别任务进行了重大改进。我们还通过将其应用于车辆重新识别和图像分类任务来证明该方法的通用性。我们的代码和模型可在https://github.com/wangwenhao0716/attentive-waveblock上找到。

Unsupervised domain adaptation (UDA) for person re-identification is challenging because of the huge gap between the source and target domain. A typical self-training method is to use pseudo-labels generated by clustering algorithms to iteratively optimize the model on the target domain. However, a drawback to this is that noisy pseudo-labels generally cause trouble in learning. To address this problem, a mutual learning method by dual networks has been developed to produce reliable soft labels. However, as the two neural networks gradually converge, their complementarity is weakened and they likely become biased towards the same kind of noise. This paper proposes a novel light-weight module, the Attentive WaveBlock (AWB), which can be integrated into the dual networks of mutual learning to enhance the complementarity and further depress noise in the pseudo-labels. Specifically, we first introduce a parameter-free module, the WaveBlock, which creates a difference between features learned by two networks by waving blocks of feature maps differently. Then, an attention mechanism is leveraged to enlarge the difference created and discover more complementary features. Furthermore, two kinds of combination strategies, i.e. pre-attention and post-attention, are explored. Experiments demonstrate that the proposed method achieves state-of-the-art performance with significant improvements on multiple UDA person re-identification tasks. We also prove the generality of the proposed method by applying it to vehicle re-identification and image classification tasks. Our codes and models are available at https://github.com/WangWenhao0716/Attentive-WaveBlock.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源