论文标题
使用感官和叙述的系统理解图像理解的系统
A System for Image Understanding using Sensemaking and Narrative
论文作者
论文摘要
感官和叙事是关于人们如何理解周围世界的两个固有相互联系的概念。感官是人们在世界上遇到的信息与过去所做的知识和推论结构和互连的过程。叙事是人们使用感官创建的重要结构。反映的人比任何给定叙述中的信息都可以单独提供对世界的整体描述。两者对于人类如何解析世界都很重要，并且对于试图做同样的计算系统来说都是有价值的。在本文中，我们讨论了人们如何根据他们遇到的信息以及感官和叙事研究领域之间的联系，讨论人们如何建立对世界的理解的理论。我们重点介绍了一项特定的计算任务，视觉讲故事，我们认为可以通过采用感官和叙事组成部分来增强其解决方案。然后，我们描述了使用感官和叙述的视觉讲故事的系统，并讨论了当前实施中的示例。
Sensemaking and narrative are two inherently interconnected concepts about how people understand the world around them. Sensemaking is the process by which people structure and interconnect the information they encounter in the world with the knowledge and inferences they have made in the past. Narratives are important constructs that people use sensemaking to create; ones that reflect provide a more holistic account of the world than the information within any given narrative is able to alone. Both are important to how human beings parse the world, and both would be valuable for a computational system attempting to do the same. In this paper, we discuss theories of sensemaking and narrative with respect to how people build an understanding of the world based on the information they encounter, as well as the links between the fields of sensemaking and narrative research. We highlight a specific computational task, visual storytelling, whose solutions we believe can be enhanced by employing a sensemaking and narrative component. We then describe our system for visual storytelling using sensemaking and narrative and discuss examples from its current implementation.
