论文标题

强大的人通过上下文相互提升重新识别

Robust Person Re-Identification through Contextual Mutual Boosting

论文作者

Wang, Zhikang, He, Lihuo, Gao, Xinbo, Shen, Jane

论文摘要

在深度学习的发展驱动的驱动下,人重新识别(RE-ID)目睹了巨大的进步。但是,现代人的重新ID仍然受到背景混乱,阻塞和巨大姿势变化的挑战,这在实践中很常见。先前的方法通过外部线索(例如,姿势估计,人解析)或注意机制来应对行人,应对这些挑战,遭受高计算成本和增加模型复杂性。在本文中,我们提出了上下文相互增强网络(CMBN)。它通过有效利用上下文信息和统计推断来定位行人并重新校准特征。首先,我们构建了两个具有共同卷积前端的分支,分别学习前景和背景特征。通过在这两个分支之间启用相互作用,它们相互提高了空间定位的准确性。其次,从统计的角度开始,我们提出了掩模生成器,该掩模生成器利用转换矩阵的激活分布,以生成静态通道掩码为表示。面膜重新校准了特征,以扩大有价值的特征并减少噪声。最后,我们提出了上下文解决策略,以共同和独立地优化两个分支,从而进一步提高了本地化精度。基准上的实验证明了与最先进的建筑相比的优势。

Person Re-Identification (Re-ID) has witnessed great advance, driven by the development of deep learning. However, modern person Re-ID is still challenged by background clutter, occlusion and large posture variation which are common in practice. Previous methods tackle these challenges by localizing pedestrians through external cues (e.g., pose estimation, human parsing) or attention mechanism, suffering from high computation cost and increased model complexity. In this paper, we propose the Contextual Mutual Boosting Network (CMBN). It localizes pedestrians and recalibrates features by effectively exploiting contextual information and statistical inference. Firstly, we construct two branches with a shared convolutional frontend to learn the foreground and background features respectively. By enabling interaction between these two branches, they boost the accuracy of the spatial localization mutually. Secondly, starting from a statistical perspective, we propose the Mask Generator that exploits the activation distribution of the transformation matrix for generating the static channel mask to the representations. The mask recalibrates the features to amplify the valuable characteristics and diminish the noise. Finally, we propose the Contextual-Detachment Strategy to optimize the two branches jointly and independently, which further enhances the localization precision. Experiments on the benchmarks demonstrate the superiority of the architecture compared the state-of-the-art.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源