论文标题
REST API的自动测试生成：尚无时间休息
Automated Test Generation for REST APIs: No Time to Rest Yet
论文作者
论文摘要
现代Web服务通常为客户提供REST API，以访问其功能。这些API提出了自动测试的独特挑战和机会，推动了许多技术和工具的最新开发，这些技术和工具可以使用各种策略为API端点生成测试用例。由于已经在不同的基准测试和使用不同的指标上对这些技术进行比较是很困难的。为了填补这一空白，我们进行了一项实证研究，旨在了解REST API的自动测试中的景观，并指导该领域的未来研究。我们首先通过系统的选择过程确定了一组10个最先进的REST API测试工具，其中包括研究人员和从业人员开发的工具。然后，我们将这些工具应用于20个现实世界开源的Restful服务的基准，并在触发的代码覆盖范围和触发独特的故障方面分析了它们的性能。这种分析使我们能够确定所考虑工具及其基本策略的优势，劣势和局限性，以及我们发现对该领域未来研究的含义。
Modern web services routinely provide REST APIs for clients to access their functionality. These APIs present unique challenges and opportunities for automated testing, driving the recent development of many techniques and tools that generate test cases for API endpoints using various strategies. Understanding how these techniques compare to one another is difficult, as they have been evaluated on different benchmarks and using different metrics. To fill this gap, we performed an empirical study aimed to understand the landscape in automated testing of REST APIs and guide future research in this area. We first identified, through a systematic selection process, a set of 10 state-of-the-art REST API testing tools that included tools developed by both researchers and practitioners. We then applied these tools to a benchmark of 20 real-world open-source RESTful services and analyzed their performance in terms of code coverage achieved and unique failures triggered. This analysis allowed us to identify strengths, weaknesses, and limitations of the tools considered and of their underlying strategies, as well as implications of our findings for future research in this area.
