论文标题
迈向现实的优化基准：关于现实世界问题属性的问卷
Towards Realistic Optimization Benchmarks: A Questionnaire on the Properties of Real-World Problems
论文作者
论文摘要
基准是用于经验性能比较的有用工具。但是，现有基准的主要缺点之一是，它在很大程度上尚不清楚它们与现实世界中的问题如何相关。算法在基准上的性能如何看待其在特定现实世界中的潜力？这项工作旨在通过对现实世界，多，多目标优化问题的问卷调查来确定现实世界中问题的属性。根据最初的响应，可以确定在现实基准设计中必须考虑的一些挑战。未来工作的一个关键是收集对问卷的更多回答，以允许对属性的共同组合进行分析。反过来，这种常见的组合然后可以包括在改进的基准套件中。为了收集更多数据，邀请读者参加：https：//tinyurl.com/opt-survey的问卷
Benchmarks are a useful tool for empirical performance comparisons. However, one of the main shortcomings of existing benchmarks is that it remains largely unclear how they relate to real-world problems. What does an algorithm's performance on a benchmark say about its potential on a specific real-world problem? This work aims to identify properties of real-world problems through a questionnaire on real-world single-, multi-, and many-objective optimization problems. Based on initial responses, a few challenges that have to be considered in the design of realistic benchmarks can already be identified. A key point for future work is to gather more responses to the questionnaire to allow an analysis of common combinations of properties. In turn, such common combinations can then be included in improved benchmark suites. To gather more data, the reader is invited to participate in the questionnaire at: https://tinyurl.com/opt-survey
