论文标题
烤饼:向对话的素描创作
Scones: Towards Conversational Authoring of Sketches
论文作者
论文摘要
迭代的精炼和批评草图是开发有效设计的关键步骤。我们介绍了Scones,这是一种混合发射,机器学习驱动的系统,使用户可以从文本说明中迭代作者素描。 Scones是一种基于深层学习的新型系统,它迭代地生成了由自然语言的语义规范组成的草图对象的场景。 Scone超过了基于文本的场景修改任务上的最先进的性能,并引入了面具条件的草图模型,该模型可以生成用高级场景信息指定的姿势的草图。在对烤饼的探索性用户评估中,参与者报告说,享受带有烤饼的迭代绘画任务,并为进一步的应用提供了其他功能。我们认为,烤饼是朝着自动化的智能系统迈出的早期一步,可以通过艺术和设计中的素描来支持人类的循环应用程序。
Iteratively refining and critiquing sketches are crucial steps to developing effective designs. We introduce Scones, a mixed-initiative, machine-learning-driven system that enables users to iteratively author sketches from text instructions. Scones is a novel deep-learning-based system that iteratively generates scenes of sketched objects composed with semantic specifications from natural language. Scones exceeds state-of-the-art performance on a text-based scene modification task, and introduces a mask-conditioned sketching model that can generate sketches with poses specified by high-level scene information. In an exploratory user evaluation of Scones, participants reported enjoying an iterative drawing task with Scones, and suggested additional features for further applications. We believe Scones is an early step towards automated, intelligent systems that support human-in-the-loop applications for communicating ideas through sketching in art and design.