论文标题
Grillbot:具有神经语义解析和基于图表的现实世界任务的助手
GRILLBot: An Assistant for Real-World Tasks with Neural Semantic Parsing and Graph-Based Representations
论文作者
论文摘要
Grillbot是2022年Alexa奖Taskbot挑战赛中的获胜系统,朝着下一代多模式任务助手迈进。它是一位语音助手,可以指导用户完成烹饪和家庭装修领域中复杂的现实世界任务。这些是长期且复杂的任务,需要灵活调整和适应。演示突出了核心方面,包括一个新型的神经决策解析器,用于上下文化语义解析,一种支持有条件执行的新“任务图”状态表示,知识接收的chit chat以及使用图像和视频自动丰富任务。
GRILLBot is the winning system in the 2022 Alexa Prize TaskBot Challenge, moving towards the next generation of multimodal task assistants. It is a voice assistant to guide users through complex real-world tasks in the domains of cooking and home improvement. These are long-running and complex tasks that require flexible adjustment and adaptation. The demo highlights the core aspects, including a novel Neural Decision Parser for contextualized semantic parsing, a new "TaskGraph" state representation that supports conditional execution, knowledge-grounded chit-chat, and automatic enrichment of tasks with images and videos.