论文标题

Grillbot:具有神经语义解析和基于图表的现实世界任务的助手

GRILLBot: An Assistant for Real-World Tasks with Neural Semantic Parsing and Graph-Based Representations

论文作者

Gemmell, Carlos, Mackie, Iain, Owoicho, Paul, Rossetto, Federico, Fischer, Sophie, Dalton, Jeffrey

论文摘要

Grillbot是2022年Alexa奖Taskbot挑战赛中的获胜系统,朝着下一代多模式任务助手迈进。它是一位语音助手,可以指导用户完成烹饪和家庭装修领域中复杂的现实世界任务。这些是长期且复杂的任务,需要灵活调整和适应。演示突出了核心方面,包括一个新型的神经决策解析器,用于上下文化语义解析,一种支持有条件执行的新“任务图”状态表示,知识接收的chit chat以及使用图像和视频自动丰富任务。

GRILLBot is the winning system in the 2022 Alexa Prize TaskBot Challenge, moving towards the next generation of multimodal task assistants. It is a voice assistant to guide users through complex real-world tasks in the domains of cooking and home improvement. These are long-running and complex tasks that require flexible adjustment and adaptation. The demo highlights the core aspects, including a novel Neural Decision Parser for contextualized semantic parsing, a new "TaskGraph" state representation that supports conditional execution, knowledge-grounded chit-chat, and automatic enrichment of tasks with images and videos.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源