Temporally coherent 4D video segmentation for teleconferencing

Jana Ehmann; Onur G. Guleryuz

doi:10.1117/12.2031740

26 September 2013 Temporally coherent 4D video segmentation for teleconferencing

Jana Ehmann, Onur G. Guleryuz

Proceedings Volume 8856, Applications of Digital Image Processing XXXVI; 88560L (2013) https://doi.org/10.1117/12.2031740
Event: SPIE Optical Engineering + Applications, 2013, San Diego, California, United States

Abstract

We develop an algorithm for 4-D (RGB+Depth) video segmentation targeting immersive teleconferencing ap- plications on emerging mobile devices. Our algorithm extracts users from their environments and places them onto virtual backgrounds similar to green-screening. The virtual backgrounds increase immersion and interac- tivity, relieving the users of the system from distractions caused by disparate environments. Commodity depth sensors, while providing useful information for segmentation, result in noisy depth maps with a large number of missing depth values. By combining depth and RGB information, our work signi¯cantly improves the other- wise very coarse segmentation. Further imposing temporal coherence yields compositions where the foregrounds seamlessly blend with the virtual backgrounds with minimal °icker and other artifacts. We achieve said improve- ments by correcting the missing information in depth maps before fast RGB-based segmentation, which operates in conjunction with temporal coherence. Simulation results indicate the e±cacy of the proposed system in video conferencing scenarios.

Citation Download Citation

Jana Ehmann and Onur G. Guleryuz "Temporally coherent 4D video segmentation for teleconferencing", Proc. SPIE 8856, Applications of Digital Image Processing XXXVI, 88560L (26 September 2013); https://doi.org/10.1117/12.2031740

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

RGB color model

Image segmentation

Video

Sensors

Video surveillance

Detection and tracking algorithms

Temporal coherence

Show All Keywords

Keywords/Phrases

Search In:

Publication Years