论文标题
通过绩效报告标准迈向游戏AI基准
Towards Game-Playing AI Benchmarks via Performance Reporting Standards
论文作者
论文摘要
尽管游戏已被广泛用作评估游戏游戏的里程碑，但没有标准化的框架来报告所获得的观察结果。结果，很难就不同游戏AI算法的优势和劣势得出一般性结论。在本文中，我们提出了有关AI游戏性能的报告指南，如果遵循，则提供适合不同AI方法之间无偏比较的信息。我们描述的愿景是基于此类准则建立基准和竞赛，以便能够就不同AI算法的行为以及不同游戏构成的挑战类型得出更一般的结论。
While games have been used extensively as milestones to evaluate game-playing AI, there exists no standardised framework for reporting the obtained observations. As a result, it remains difficult to draw general conclusions about the strengths and weaknesses of different game-playing AI algorithms. In this paper, we propose reporting guidelines for AI game-playing performance that, if followed, provide information suitable for unbiased comparisons between different AI approaches. The vision we describe is to build benchmarks and competitions based on such guidelines in order to be able to draw more general conclusions about the behaviour of different AI algorithms, as well as the types of challenges different games pose.
