论文标题
应用意识：使用计算机视觉和密码学的测试驱动的GUI开发
Applied Awareness: Test-Driven GUI Development using Computer Vision and Cryptography
论文作者
论文摘要
图形用户界面测试非常具有挑战性，并且使其自动化更多。测试驱动的开发是不切实际的：通常需要GUI的初始实现来生成黄金图像或构建交互式测试方案，并且随后的维护成本很高。尽管计算机视觉已应用于GUI测试的几个方面，但我们展示了一种新颖且立即适用于后端通信来解释GUI演示的方法，并以安全性证据所采用的方式对“意识”进行建模。这种专注于后端通信在典型的测试方法中规避缺陷，这些方法依赖于平台依赖的UI提供或可访问性功能。我们的跨学科工作已准备好进行现成的实践：我们在线和离线验证之间报告了独立的，实用的实现，一开始使用简单的设计人员规格，并特别避免了对引导程序实现或金色图像的任何要求。除了实施实际实施外，还探索和解释了与密码学中的正式验证方法的联系，从而提供了关于UI和AI中解释性的保证的肥沃观点。
Graphical user interface testing is significantly challenging, and automating it even more so. Test-driven development is impractical: it generally requires an initial implementation of the GUI to generate golden images or to construct interactive test scenarios, and subsequent maintenance is costly. While computer vision has been applied to several aspects of GUI testing, we demonstrate a novel and immediately applicable approach of interpreting GUI presentation in terms of backend communications, modeling "awareness" in the fashion employed by cryptographic proofs of security. This focus on backend communication circumvents deficiencies in typical testing methodologies that rely on platform-dependent UI affordances or accessibility features. Our interdisciplinary work is ready for off-the-shelf practice: we report self-contained, practical implementation with both online and offline validation, using simple designer specifications at the outset and specifically avoiding any requirements for a bootstrap implementation or golden images. In addition to practical implementation, ties to formal verification methods in cryptography are explored and explained, providing fertile perspectives on assurance in UI and interpretability in AI.
