论文标题
MongoDB的自动化系统性能测试
Automated System Performance Testing at MongoDB
论文作者
论文摘要
分布式系统基础架构（DSI）是MongoDB在我们连续集成（CI）环境中运行全自动系统性能测试的框架。要在CI中运行，它需要端对端自动化所有内容：供应和部署多节点群集，执行测试，调整系统以重复结果，并收集和分析结果。如今，DSI是MongoDB最常用，最有用的性能测试工具。它在每日CI中运行近200种不同的基准，我们还将其用于手动性能调查。由于我们可以及时提醒负责任的工程师，因此除了主要回归之一之外，所有其他回归均在4.2.0发布之前固定。我们还能够获得净新的改进，其中DSI抓住了17。我们于2020年3月开放了DSI。
Distributed Systems Infrastructure (DSI) is MongoDB's framework for running fully automated system performance tests in our Continuous Integration (CI) environment. To run in CI it needs to automate everything end-to-end: provisioning and deploying multi-node clusters, executing tests, tuning the system for repeatable results, and collecting and analyzing the results. Today DSI is MongoDB's most used and most useful performance testing tool. It runs almost 200 different benchmarks in daily CI, and we also use it for manual performance investigations. As we can alert the responsible engineer in a timely fashion, all but one of the major regressions were fixed before the 4.2.0 release. We are also able to catch net new improvements, of which DSI caught 17. We open sourced DSI in March 2020.
