Virtual Reality telecommunication systems promise to overcome the limitations of current real-time teleconferencing solutions, by enabling a better sense of immersion and fostering more natural interpersonal interactions. Many solutions that currently enable immersive teleconferencing employ synthetic avatars to represent their users. However, photorealistic reconstructions have been shown to increase the sense of presence with respect to synthetic avatars in tele-immersive scenarios. In this paper, we present VR2Gather, a costumizable end-to-end system to transmit volumetric contents in multi-party real-time communication. We present the architecture and evaluate the costs and benefits of using different modules and transport mechanisms in terms of CPU usage, latency, and bandwidth. Moreover, we report the user experience based on applications the system has been used for, and how it was customised to meet the requirements using different acquisition and rendering modules.

, , , , , ,
IEEE MultiMedia
VRTogether - An end-to-end system for the production and delivery of photorealistic social immersive virtual reality experiences , Ignite the Immersive Media Sector by Enabling New Narrative Visions
Centrum Wiskunde & Informatica, Amsterdam (CWI), The Netherlands

Viola, I., Jansen, J., Subramanyam, S., Reimat, I., & César Garcia, P. S. (2023). VR2Gather: A collaborative social VR system for adaptive multi-party real-time communication. IEEE MultiMedia, 1–13. doi:10.1109/MMUL.2023.3263943