论文标题

基于多分辨率融合和多尺度输入先验的人群计数

Multi-Resolution Fusion and Multi-scale Input Priors Based Crowd Counting

论文作者

Sajid, Usman, Ma, Wenchi, Wang, Guanghui

论文摘要

在静止图像中计数的人群在实践中是一个具有挑战性的问题,这是由于人群密度的巨大变化,巨大的视角变化,严重的遮挡和可变的照明条件。基于最先进的补丁缩放模块(PRM)方法被证明在改善人群计数性能方面非常有效。但是,PRM模块需要一个额外的损害人群密度分类过程。为了解决这些问题和挑战,本文提出了一个新的基于多分辨率融合的端到端人群计数网络。它采用了三个基于深层的柱/分支,每个柱/分支都可以满足各自的人群密度量表。这些列定期融合(共享)信息。网络分为三个阶段,每个阶段包含一个或多个列。引入了三个输入先验,以作为PRM模块的有效替代方案,而无需任何其他分类操作。与最终人群计数回归负责人一起,该网络还包含三个辅助人群估计回归负责人,它们在每个阶段结束上都置于战略上,以提高整体性能。三个基准数据集的全面实验表明,所提出的方法的表现优于RMSE评估指标下的所有最新模型。所提出的方法在交叉数据集实验期间还具有更好的概括能力,并具有最佳结果。

Crowd counting in still images is a challenging problem in practice due to huge crowd-density variations, large perspective changes, severe occlusion, and variable lighting conditions. The state-of-the-art patch rescaling module (PRM) based approaches prove to be very effective in improving the crowd counting performance. However, the PRM module requires an additional and compromising crowd-density classification process. To address these issues and challenges, the paper proposes a new multi-resolution fusion based end-to-end crowd counting network. It employs three deep-layers based columns/branches, each catering the respective crowd-density scale. These columns regularly fuse (share) the information with each other. The network is divided into three phases with each phase containing one or more columns. Three input priors are introduced to serve as an efficient and effective alternative to the PRM module, without requiring any additional classification operations. Along with the final crowd count regression head, the network also contains three auxiliary crowd estimation regression heads, which are strategically placed at each phase end to boost the overall performance. Comprehensive experiments on three benchmark datasets demonstrate that the proposed approach outperforms all the state-of-the-art models under the RMSE evaluation metric. The proposed approach also has better generalization capability with the best results during the cross-dataset experiments.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源