论文标题
与灵活的单元可视化进行编织的多模式互动以进行数据探索
Interweaving Multimodal Interaction with Flexible Unit Visualizations for Data Exploration
论文作者
论文摘要
结合直接操纵和自然语言的多模式界面对数据可视化显示了很大的希望。这种多模式界面使人们能够通过利用一种模态的优势来补充他人的弱点，使人们能够保持视觉探索的流程。在这项工作中，我们介绍了一种将多模式互动交织在一起的方法，将直接操纵和自然语言与灵活的单元可视化结合在一起。我们在概念验证系统数据库中采用了建议的方法。耦合笔，触摸和基于语音的多模式相互作用与灵活的单元可视化，Databreeze允许人们与系统绑定（例如散点图，单位列图）和手动定制视图创建和互动，从而启用新型的视觉数据探索体验。我们描述了我们的设计过程以及Databreeze的界面和交互作用，描述了设计的特定方面，这些方面赋予了多种模式的协同使用。我们还通过数据链式介绍了一项初步的用户研究，突出了参与者使用的数据探索模式。最后，在反思我们的设计过程和初步用户研究时，我们讨论了未来的研究方向。
Multimodal interfaces that combine direct manipulation and natural language have shown great promise for data visualization. Such multimodal interfaces allow people to stay in the flow of their visual exploration by leveraging the strengths of one modality to complement the weaknesses of others. In this work, we introduce an approach that interweaves multimodal interaction combining direct manipulation and natural language with flexible unit visualizations. We employ the proposed approach in a proof-of-concept system, DataBreeze. Coupling pen, touch, and speech-based multimodal interaction with flexible unit visualizations, DataBreeze allows people to create and interact with both systematically bound (e.g., scatterplots, unit column charts) and manually customized views, enabling a novel visual data exploration experience. We describe our design process along with DataBreeze's interface and interactions, delineating specific aspects of the design that empower the synergistic use of multiple modalities. We also present a preliminary user study with DataBreeze, highlighting the data exploration patterns that participants employed. Finally, reflecting on our design process and preliminary user study, we discuss future research directions.
