论文标题

多方全力表:虚拟现实中低成本全息会议的新时代

Multi-party Holomeetings: Toward a New Era of Low-Cost Volumetric Holographic Meetings in Virtual Reality

论文作者

Fernández, Sergi, Montagud, Mario, Cernigliaro, Gianluca, Rincón, David

论文摘要

由多方通信的进步推动,采用了越来越成熟的沉浸式技术,以及Covid-19大流行(社交虚拟现实(VR)平台的新浪潮)已出现,以支持多个远程用户之间的社交,互动和协作,这些远程用户都集成到共享虚拟环境中。社交VR旨在通过克服传统多方视频会议工具中2D窗口表示的局限性来提高(共同)的存在和交互质量,尽管大多数现有的解决方案都依靠3D化身来代表用户。本文介绍了一个社交VR平台,该平台支持用户的实时体积全息表示,该平台基于由现成的RGB-D传感器捕获的点云,并分析了该平台进行交互式全面表的潜力(即,全核对照方案)。这项工作评估了该平台的性能和准备就绪,以与多达四个用户进行会议,并在使用额叶和侧视点的方案中使用单摄像机和低成本捕获系统时,可以洞悉用户体验的各个方面。 Overall, the obtained results confirm the platform's maturity and the potential of holographic communications for conducting interactive multi-party meetings, even when using low-cost systems and single-camera capture systems in scenarios where users are sitting or have a limited translational movement along the X, Y, and Z axes within the 3D virtual environment (commonly known as 3 Degrees of Freedom plus, 3DoF+)

Fueled by advances in multi-party communications, increasingly mature immersive technologies being adopted, and the COVID-19 pandemic, a new wave of social virtual reality (VR) platforms have emerged to support socialization, interaction, and collaboration among multiple remote users who are integrated into shared virtual environments. Social VR aims to increase levels of (co-)presence and interaction quality by overcoming the limitations of 2D windowed representations in traditional multi-party video conferencing tools, although most existing solutions rely on 3D avatars to represent users. This article presents a social VR platform that supports real-time volumetric holographic representations of users that are based on point clouds captured by off-the-shelf RGB-D sensors, and it analyzes the platform's potential for conducting interactive holomeetings (i.e., holoconferencing scenarios). This work evaluates such a platform's performance and readiness for conducting meetings with up to four users, and it provides insights into aspects of the user experience when using single-camera and low-cost capture systems in scenarios with both frontal and side viewpoints. Overall, the obtained results confirm the platform's maturity and the potential of holographic communications for conducting interactive multi-party meetings, even when using low-cost systems and single-camera capture systems in scenarios where users are sitting or have a limited translational movement along the X, Y, and Z axes within the 3D virtual environment (commonly known as 3 Degrees of Freedom plus, 3DoF+)

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源