论文标题
SURDS:自我监督的注意引导的重建和作家独立离线签名验证的双重损失
SURDS: Self-Supervised Attention-guided Reconstruction and Dual Triplet Loss for Writer Independent Offline Signature Verification
论文作者
论文摘要
离线签名验证(OSV)是各种法医,商业和法律应用的基本生物识别任务。手头的基本任务是仔细建模签名的细颗粒特征,以区分真正的和锻造的特征,而真正的和锻造的特征仅在微小畸形方面有所不同。与其他验证问题相比,这使OSV更具挑战性。在这项工作中,我们提出了一个两阶段的深度学习框架,该框架利用自我监督的表示学习以及对作家独立于独立的OSV的指标学习。首先,我们使用编码器架构来训练图像重建网络,该架构通过使用签名图像贴片的2D空间注意机制增强。接下来,使用监督的度量学习框架对训练有素的编码器主链进行微调,其目标是通过从同一作者班以及其他作家中抽样负面样本来优化新颖的双重损失。与之相比,与签名样品和跨撰稿人集的负样本相比,这背后的直觉是确保签名样本更接近其正对应物。这会导致对嵌入空间的强大歧视学习。据我们所知,这是为OSV使用自我监督的学习框架的第一部作品。已提出的两阶段框架已在两个公开可用的离线签名数据集上进行了评估,并与各种最新方法进行了比较。注意到,所提出的方法提供了令人鼓舞的结果,其表现优于几个现有的工作。该代码可在以下公开信息:https://github.com/soumitri2001/surds-ssl-osv
Offline Signature Verification (OSV) is a fundamental biometric task across various forensic, commercial and legal applications. The underlying task at hand is to carefully model fine-grained features of the signatures to distinguish between genuine and forged ones, which differ only in minute deformities. This makes OSV more challenging compared to other verification problems. In this work, we propose a two-stage deep learning framework that leverages self-supervised representation learning as well as metric learning for writer-independent OSV. First, we train an image reconstruction network using an encoder-decoder architecture that is augmented by a 2D spatial attention mechanism using signature image patches. Next, the trained encoder backbone is fine-tuned with a projector head using a supervised metric learning framework, whose objective is to optimize a novel dual triplet loss by sampling negative samples from both within the same writer class as well as from other writers. The intuition behind this is to ensure that a signature sample lies closer to its positive counterpart compared to negative samples from both intra-writer and cross-writer sets. This results in robust discriminative learning of the embedding space. To the best of our knowledge, this is the first work of using self-supervised learning frameworks for OSV. The proposed two-stage framework has been evaluated on two publicly available offline signature datasets and compared with various state-of-the-art methods. It is noted that the proposed method provided promising results outperforming several existing pieces of work. The code is publicly available at: https://github.com/soumitri2001/SURDS-SSL-OSV