论文标题
一种基于虚拟现实的方法，用于检查视听韵律知觉
A virtual reality-based method for examining audiovisual prosody perception
论文作者
论文摘要
韵律在言语交流中起着至关重要的作用。韵律的声明已被广泛研究。但是，韵律特征不仅是受理性的，而且在视觉上是基于头部和面部运动。本报告的目的是提出一种使用虚拟现实检查视听韵律的方法。我们表明，基于虚拟人的动画提供了类似于真正说话者视频录音的动作提示。虚拟现实的使用开辟了新的途径，以检查口头交流的多模式效应。我们讨论了研究人工耳蜗听众中韵律感知的框架中的方法。
Prosody plays a vital role in verbal communication. Acoustic cues of prosody have been examined extensively. However, prosodic characteristics are not only perceived auditorily, but also visually based on head and facial movements. The purpose of this report is to present a method for examining audiovisual prosody using virtual reality. We show that animations based on a virtual human provide motion cues similar to those obtained from video recordings of a real talker. The use of virtual reality opens up new avenues for examining multimodal effects of verbal communication. We discuss the method in the framework of examining prosody perception in cochlear implant listeners.
