On media data structures for interactive streaming in immersive applications

Gene Cheung; Antonio Ortega; Ngai-Man Cheung; Bernd Girod

doi:10.1117/12.863532

30 July 2010 On media data structures for interactive streaming in immersive applications

Gene Cheung, Antonio Ortega, Ngai-Man Cheung, Bernd Girod

Proceedings Volume 7744, Visual Communications and Image Processing 2010; 77440O (2010) https://doi.org/10.1117/12.863532
Event: Visual Communications and Image Processing 2010, 2010, Huangshan, China

Abstract

Interactive media streaming is the communication paradigm where an observer periodically requests new desired subsets from the streaming sender in real-time, upon which the sender sends the appropriate media data, corresponding to the received requests, for immediate decoding and display. This is in contrast to non-interactive media streaming, e.g., TV broadcast, where the entire media set is compressed and delivered to the observer before the observer interacts with the data (such as switching TV channels). Examples of interactive streaming abound in different media modalities: interactive browsing of JPEG2000 images, interactive light field or multiview video streaming, etc. Interactive media streaming has the obvious advantage of bandwidth efficiency: only the media subsets corresponding to observer's requests are transmitted. This is important when an observer only views a small subset out of a very large media data set during a typical streaming session. The technical challenge is how to structure media data such that good compression efficiency can be achieved by exploiting correlation among media subsets (thus inducing a particular decoding order if correlation is exploited during encoding), while providing sufficient flexibility for the observer to freely navigate the media data set in his/her desired unique order. In this overview paper, we survey different proposals in the literature that simultaneously achieve the conflicting objectives of compression efficiency and decoding flexibility.

Citation Download Citation

Gene Cheung, Antonio Ortega, Ngai-Man Cheung, and Bernd Girod "On media data structures for interactive streaming in immersive applications", Proc. SPIE 7744, Visual Communications and Image Processing 2010, 77440O (30 July 2010); https://doi.org/10.1117/12.863532

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available