论文标题
Vinter：具有情感感知变压器的图像叙事产生
ViNTER: Image Narrative Generation with Emotion-Arc-Aware Transformer
论文作者
论文摘要
图像叙事生成是从具有主观观点的图像创建故事的任务。鉴于作家，读者和角色在讲故事中的主观感受的重要性，图像叙事生成方法应考虑人类的情感。在这项研究中，我们提出了一种名为Vinter（带有情感弧表示的视觉叙事变压器）的新型图像叙事生成方法，该方法将“情感弧”作为捕获一系列情感变化的输入。由于情感弧代表情绪变化的轨迹，因此可以预期我们可以将有关故事中情感变化的详细信息包含在模型中。我们在图像叙事数据集上介绍了自动评估和手动评估的实验结果，并证明了所提出的方法的有效性。
Image narrative generation is a task to create a story from an image with a subjective viewpoint. Given the importance of the subjective feelings of writers, readers, and characters in storytelling, an image narrative generation method should consider human emotion. In this study, we propose a novel method of image narrative generation called ViNTER (Visual Narrative Transformer with Emotion arc Representation), which takes "emotion arc" as input to capture a sequence of emotional changes. Since emotion arcs represent the trajectory of emotional change, it is expected that we can include detailed information about the emotional changes in the story to the model. We present experimental results of both automatic and manual evaluations on the Image Narrative dataset and demonstrate the effectiveness of the proposed approach.
