论文标题
决策树的质量多样性进化学习
Quality Diversity Evolutionary Learning of Decision Trees
论文作者
论文摘要
满足对机器学习的需求已成为现代人工智能(AI)中最重要的研究方向之一。尽管该领域中当前的主导范式基于黑框模型,通常是以(深)神经网络的形式进行的,但这些模型对人类用户的直接解释性缺乏直接的解释性,即它们的结果(甚至更是如此,他们的内部工作)是不透明的,难以理解。这阻碍了AI在安全至关重要的应用中的采用,在这些应用中,高利益受到威胁。在这些应用中,可以通过设计模型(例如决策树)来解释,因为它们提供了解释性。最近的作品提出了决策树和增强学习的杂交,以结合两种方法的优势。但是,到目前为止,这些作品集中在这些混合模型的优化上。在这里,我们将MAP-PELITE应用于捕获模型复杂性及其行为可变性的特征空间中多元化的混合模型。我们将我们的方法应用于Openai Gym图书馆的两个众所周知的控制问题,在该问题上,我们讨论了Map-Elites投影的“照明”模式,将其结果与现有类似方法进行了比较。
Addressing the need for explainable Machine Learning has emerged as one of the most important research directions in modern Artificial Intelligence (AI). While the current dominant paradigm in the field is based on black-box models, typically in the form of (deep) neural networks, these models lack direct interpretability for human users, i.e., their outcomes (and, even more so, their inner working) are opaque and hard to understand. This is hindering the adoption of AI in safety-critical applications, where high interests are at stake. In these applications, explainable by design models, such as decision trees, may be more suitable, as they provide interpretability. Recent works have proposed the hybridization of decision trees and Reinforcement Learning, to combine the advantages of the two approaches. So far, however, these works have focused on the optimization of those hybrid models. Here, we apply MAP-Elites for diversifying hybrid models over a feature space that captures both the model complexity and its behavioral variability. We apply our method on two well-known control problems from the OpenAI Gym library, on which we discuss the "illumination" patterns projected by MAP-Elites, comparing its results against existing similar approaches.