论文标题
新颖的搜索使得可发展性不可避免
Novelty Search makes Evolvability Inevitable
论文作者
论文摘要
进化性是一个重要的特征,它会影响进化过程找到有趣的新解决方案并处理不断变化的问题要解决的能力。进化性的估计并不简单,通常太贵了,无法直接用作进化过程中的选择性压力。因此,间接促进可发展性作为其他更容易,更快地计算选择压力的副作用将是有利的。在无限的行为空间中,已经证明可演化的个体自然而然地出现并倾向于被选中,因为他们更有可能入侵空的行为壁nik。因此,在这种情况下,可发展性是搜索的自然副产品。但是,实用的代理和环境通常会对可及行为空间施加限制。这些界限如何影响发展性?在这种情况下,可以在不明确奖励它的情况下晋升可进化性吗?我们表明,新颖性搜索即使在有限的行为空间中也隐含地造成了高发展性的压力,并探索了这种行为的原因。更确切地说,在整个搜索过程中,对新颖性奖励个人在行为空间中非常流动的新颖性奖励的动态评估又促进了可发展性。
Evolvability is an important feature that impacts the ability of evolutionary processes to find interesting novel solutions and to deal with changing conditions of the problem to solve. The estimation of evolvability is not straightforward and is generally too expensive to be directly used as selective pressure in the evolutionary process. Indirectly promoting evolvability as a side effect of other easier and faster to compute selection pressures would thus be advantageous. In an unbounded behavior space, it has already been shown that evolvable individuals naturally appear and tend to be selected as they are more likely to invade empty behavior niches. Evolvability is thus a natural byproduct of the search in this context. However, practical agents and environments often impose limits on the reach-able behavior space. How do these boundaries impact evolvability? In this context, can evolvability still be promoted without explicitly rewarding it? We show that Novelty Search implicitly creates a pressure for high evolvability even in bounded behavior spaces, and explore the reasons for such a behavior. More precisely we show that, throughout the search, the dynamic evaluation of novelty rewards individuals which are very mobile in the behavior space, which in turn promotes evolvability.