A sub-picture-based omnidirectional video live streaming platform

Srinivas Gudumasu; Ahmed Hamza; Yong He; Yan Ye

doi:10.1117/12.2501264

17 September 2018 A sub-picture-based omnidirectional video live streaming platform

Srinivas Gudumasu, Ahmed Hamza, Yong He, Yan Ye

Proceedings Volume 10752, Applications of Digital Image Processing XLI; 1075234 (2018) https://doi.org/10.1117/12.2501264
Event: SPIE Optical Engineering + Applications, 2018, San Diego, California, United States

Abstract

MPEG Omnidirectional Media Format (OMAF) specifies both a viewport-dependent video profile and a viewportdependent presentation profile to enable immersive media applications. A sub-picture-based approach for viewportdependent streaming is one of the main approaches being explored in MPEG OMAF standardization. This paper presents a sub-picture-based omnidirectional video live streaming platform with state of the art technologies integrated on both server and client sides to illustrate the benefits of such viewport-dependent omnidirectional video streaming approach. The technologies include omnidirectional video acquisition, sub-picture partitioning, real-time GPUaccelerated HEVC encoding and DASH-based live streaming. The presented platform supports virtual reality (VR) clients including both VR head-mounted displays (HMDs) and conventional 2D displays. Viewing orientation tracking and realtime viewport extraction are also supported in our platform. As with all live streaming platforms, one of the main goals of our platform is to minimize end-to-end system latency. A new metric called Comparable-Quality Viewport Switching (CQVS) latency is proposed to evaluate the performance of viewport dependent video streaming and presentation. The CQVS latency is defined as the amount of time it takes for the viewport video quality to improve to a level comparable to that prior to viewport switching. The platform was demonstrated in the Joint 3GPP and VRIF workshop on VR and the 2018 Mobile World Congress as one of the first OMAF-compliant viewport-dependent live streaming solutions.

Citation Download Citation

Srinivas Gudumasu, Ahmed Hamza, Yong He, and Yan Ye "A sub-picture-based omnidirectional video live streaming platform", Proc. SPIE 10752, Applications of Digital Image Processing XLI, 1075234 (17 September 2018); https://doi.org/10.1117/12.2501264

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available