2020-05-27
A pipeline for multiparty volumetric video conferencing: Transmission of point clouds over low latency DASH
Publication
Publication
The advent of affordable 3D capture and display hardware is making volumetric videoconferencing feasible. This technology increases the immersion of the participants, breaking the flat restriction of 2D screens, by allowing them to collaborate and interact in shared virtual reality spaces. In this paper we introduce the design and development of an architecture intended for volumetric videoconferencing that provides a highly realistic 3D representation of the participants, based on pointclouds. A pointcloud representation is suitable for real-time applications like video conferencing, due to its low-complexity and because it does not need a time consuming reconstruction process. As transport protocol we selected low latency DASH, due to its popularity and client-based adaptation mechanisms for tiling. This paper presents the architectural design, details the implementation, and provides some referential results. The demo will showcase the system in action, enabling volumetric videoconferencing using pointclouds.
| Additional Metadata | |
|---|---|
| , , | |
| Motion Spell, Paris, France | |
| doi.org/10.1145/3339825.3393578 | |
| VRTogether - An end-to-end system for the production and delivery of photorealistic social immersive virtual reality experiences | |
| ACM Multimedia Systems Conference | |
| Organisation | Centrum Wiskunde & Informatica, Amsterdam (CWI), The Netherlands |
|
Jansen, J., Subramanyam, S., Bouqueau, R., Cernigliaro, G., Martos Cabré, M., Pérez, F., & César Garcia, P. S. (2020). A pipeline for multiparty volumetric video conferencing: Transmission of point clouds over low latency DASH. In MMSys 2020 - Proceedings of the 2020 Multimedia Systems Conference (pp. 341–344). doi:10.1145/3339825.3393578 |
|
