论文标题
使用内在动机发现分层的负担能力发现
Hierarchical Affordance Discovery using Intrinsic Motivation
论文作者
论文摘要
为了在现实生活环境中终身学习,机器人必须应对多个挑战。能够将他们可能在环境中观察到的物理特性与可能的相互作用相关联是其中之一。这种称为“负担能力学习”的技能与体现密切相关,并通过每个人的发展掌握:每个人通过与周围环境的互动来不同。当前的负担能力学习方法通常使用固定的动作来学习这些负担能力,或者专注于涉及要操作的机器人臂的静态设置。在本文中,我们提出了一种使用内在动机来指导移动机器人提供的能力的算法。该算法能够自主发现,学习和调整相互关联的负担,而无需进行预编程的动作。一旦获悉,算法就可以使用这些负担来计划一系列动作,以执行各种困难的任务。然后,我们提出一个实验并分析我们的系统,然后将其与增强学习和负担能力学习的其他方法进行比较。
To be capable of lifelong learning in a real-life environment, robots have to tackle multiple challenges. Being able to relate physical properties they may observe in their environment to possible interactions they may have is one of them. This skill, named affordance learning, is strongly related to embodiment and is mastered through each person's development: each individual learns affordances differently through their own interactions with their surroundings. Current methods for affordance learning usually use either fixed actions to learn these affordances or focus on static setups involving a robotic arm to be operated. In this article, we propose an algorithm using intrinsic motivation to guide the learning of affordances for a mobile robot. This algorithm is capable to autonomously discover, learn and adapt interrelated affordances without pre-programmed actions. Once learned, these affordances may be used by the algorithm to plan sequences of actions in order to perform tasks of various difficulties. We then present one experiment and analyse our system before comparing it with other approaches from reinforcement learning and affordance learning.