论文标题
IBP正则化,用于通过分支和束缚的经过验证的对抗鲁棒性
IBP Regularization for Verified Adversarial Robustness via Branch-and-Bound
论文作者
论文摘要
最近的工作试图通过对比原始扰动大的域进行攻击,并在目标中添加各种正则化项,从而提高受对抗训练的网络的可验证性。但是,这些算法的表现不佳或需要复杂且昂贵的阶段训练程序,从而阻碍了它们的实际适用性。我们提出了IBP-R,这是一种新颖的经过验证的培训算法,既简单又有效。 IBP-R通过基于廉价的间隔结合传播对扩大域的对抗域进行对抗性攻击来诱导网络可验证性,从而最大程度地减少了非凸vex验证问题与其近似值之间的差距。通过利用最近的分支机构和结合的框架,我们表明IBP-R获得了最先进的核能 - 智能智能权衡取舍,以使CIFAR-10的小扰动在CIFAR-10上,而培训的速度明显快于相关的先前工作。此外,我们提出了UPB,这是一种新颖的分支策略,它依赖于基于$β$ crown的简单启发式,可降低最新的分支分支算法的成本,同时产生可比质量的分裂。
Recent works have tried to increase the verifiability of adversarially trained networks by running the attacks over domains larger than the original perturbations and adding various regularization terms to the objective. However, these algorithms either underperform or require complex and expensive stage-wise training procedures, hindering their practical applicability. We present IBP-R, a novel verified training algorithm that is both simple and effective. IBP-R induces network verifiability by coupling adversarial attacks on enlarged domains with a regularization term, based on inexpensive interval bound propagation, that minimizes the gap between the non-convex verification problem and its approximations. By leveraging recent branch-and-bound frameworks, we show that IBP-R obtains state-of-the-art verified robustness-accuracy trade-offs for small perturbations on CIFAR-10 while training significantly faster than relevant previous work. Additionally, we present UPB, a novel branching strategy that, relying on a simple heuristic based on $β$-CROWN, reduces the cost of state-of-the-art branching algorithms while yielding splits of comparable quality.