论文标题
数据驱动的加固学习解决方案框架,用于最佳和适应性个性化的臀部外骨骼
A Data-Driven Reinforcement Learning Solution Framework for Optimal and Adaptive Personalization of a Hip Exoskeleton
论文作者
论文摘要
机器人外骨骼是增强人类流动性的令人兴奋的技术。但是,设计这样的设备与人类用户无缝集成并协助人类运动仍然是一个重大挑战。本文旨在开发基于增强学习(RL)的新型数据驱动的解决方案框架,而没有先建模人类机器人动态,以提供最佳和适应性的个性化扭矩帮助,以减少步行过程中人类的努力。我们的自动个性化解决方案框架包括带有两个控制正时参数(峰值和偏移时间)的辅助扭矩轮廓,用于学习参数调整策略的最小平方策略迭代(LSPI)以及基于转移的工作比率的成本函数。拟议的控制器在健康的人类受试者上已成功验证,以帮助步行中的单侧髋关节扩展。结果表明,最佳和自适应的RL控制器作为一种新方法是可行的,可用于调整髋部外骨骼的辅助扭矩轮廓,该髋骨骼与人类作用协调并降低了人类髋关节伸肌的激活水平。
Robotic exoskeletons are exciting technologies for augmenting human mobility. However, designing such a device for seamless integration with the human user and to assist human movement still is a major challenge. This paper aims at developing a novel data-driven solution framework based on reinforcement learning (RL), without first modeling the human-robot dynamics, to provide optimal and adaptive personalized torque assistance for reducing human efforts during walking. Our automatic personalization solution framework includes the assistive torque profile with two control timing parameters (peak and offset timings), the least square policy iteration (LSPI) for learning the parameter tuning policy, and a cost function based on transferred work ratio. The proposed controller was successfully validated on a healthy human subject to assist unilateral hip extension in walking. The results showed that the optimal and adaptive RL controller as a new approach was feasible for tuning assistive torque profile of the hip exoskeleton that coordinated with human actions and reduced activation level of hip extensor muscle in human.