1. Dynamic Adaptive Mesh Streaming for Real-time 3D Teleimmersion
- Author
-
Dimitrios Zarpalas, Alexandros Doumanoglou, Petros Daras, Simon Crowle, Michael Boniface, Benjamin Poussard, University of Southampton, University of Thessaloniki, Laboratoire Angevin de Mécanique, Procédés et InnovAtion (LAMPA), Université de Bordeaux (UB)-Institut Polytechnique de Bordeaux-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement (INRAE)-Arts et Métiers Sciences et Technologies, HESAM Université (HESAM)-HESAM Université (HESAM), and This work was supported by the EU funded project 3DLIVE, GA 318483. http://3dliveproject.eu
- Subjects
content adaptation ,network monitoring ,adaptive compression ,Computer science ,Quality of service ,[SHS.INFO]Humanities and Social Sciences/Library and information sciences ,3D reconstruction ,Real-time computing ,Process (computing) ,QoS ,020207 software engineering ,02 engineering and technology ,Network monitoring ,Content adaptation ,Pipeline (software) ,Mixed reality ,Sciences de l'information et de la communication [Sciences de l'Homme et Société] ,0202 electrical engineering, electronic engineering, information engineering ,020201 artificial intelligence & image processing ,Network performance - Abstract
Recent advances in full body 3D reconstruction methods have lead to the realisation of high quality, real-time, photo realistic capture of users in a range of tele-immersion (TI) contexts including gaming and mixed reality environments. The full body reconstruction (FBR) process is computationally expensive requiring comparatively high CPU, GPU and network resources in order to maintain a shared, virtual reality in which high quality 3D reproductions of users can be rendered in real-time. A significant optimisation of the delivery of FBR content has been achieved through the realtime compression and de-compression of 3D geometry and textures. Here we present a new, adaptive compression methodology that allows a TI system called 3D-LIVE to modify the quality and speed of a FBR TI pipeline based on the data carrying capability of the network. Our rule-based adaptation strategy uses network performance sampling processes and a configurable rule engine to dynamically alter the compression of FBR reconstruction on-the-fly. We demonstrate the efficacy of the approach with an experimental evaluation of system and conclude with a discussion of future directions for adaptive FBR compression. This work was supported by the EU funded project 3DLIVE, GA 318483. http://3dliveproject.eu/
- Published
- 2015