论文标题
基准测试和未来计算的基准测试观点
A BenchCouncil View on Benchmarking Emerging and Future Computing
论文作者
论文摘要
计算机，管理或财务学科中伪影或对象的可测量特性是外部的，而不是固有的 - 取决于其问题的定义和解决方案实例。只有在实例化之后，才能测量解决问题的解决方案。定义，实例化和测量的过程被纠缠在一起，它们具有复杂的相互影响。同时，该技术惯性带来了实例化偏见 - 被困在高维溶液空间的子空间甚至点。这些艰巨的挑战会加剧计算的加剧，使计量学对基准社区无法使用。它迫切需要建立独立的基准科学和工程。 本文介绍了一个统一的基准定义，一个概念框架以及可追溯和有监督的基于学习的基准方法，为基准科学和工程奠定了基础。我还讨论了Benchcouncil的新兴和未来计算计划。正在进行的项目包括定义智力，本能，量子计算机，元计算机，行星级计算机的挑战，以及重新设计数据中心，科学人工智能和CPU基准套件。此外，Benchcouncil将与ComputerCouncil在开源计算机系统上合作，用于行星规模计算，用于科学系统的AI和Metaverse。
The measurable properties of the artifacts or objects in the computer, management, or finance disciplines are extrinsic, not inherent -- dependent on their problem definitions and solution instantiations. Only after the instantiation can the solutions to the problem be measured. The processes of definition, instantiation, and measurement are entangled, and they have complex mutual influences. Meanwhile, the technology inertia brings instantiation bias -- trapped into a subspace or even a point at a high-dimension solution space. These daunting challenges, which emerging computing aggravates, make metrology can not work for benchmark communities. It is pressing to establish independent benchmark science and engineering. This article presents a unifying benchmark definition, a conceptual framework, and a traceable and supervised learning-based benchmarking methodology, laying the foundation for benchmark science and engineering. I also discuss BenchCouncil's plans for emerging and future computing. The ongoing projects include defining the challenges of intelligence, instinct, quantum computers, Metaverse, planet-scale computers, and reformulating data centers, artificial intelligence for science, and CPU benchmark suites. Also, BenchCouncil will collaborate with ComputerCouncil on open-source computer systems for planet-scale computing, AI for science systems, and Metaverse.
