A spatiotemporal decomposition strategy for personal home video management

Haoran Yi; Igor Kozintsev; Marzia Polito; Yi Wu; Jean-Yves Bouguet; Ara Nefian; Carole Dulong

doi:10.1117/12.704599

29 January 2007 A spatiotemporal decomposition strategy for personal home video management

Haoran Yi, Igor Kozintsev, Marzia Polito, Yi Wu, Jean-Yves Bouguet, Ara Nefian, Carole Dulong

Proceedings Volume 6506, Multimedia Content Access: Algorithms and Systems; 65060Q (2007) https://doi.org/10.1117/12.704599
Event: Electronic Imaging 2007, 2007, San Jose, CA, United States

Abstract

With the advent and proliferation of low cost and high performance digital video recorder devices, an increasing number of personal home video clips are recorded and stored by the consumers. Compared to image data, video data is lager in size and richer in multimedia content. Efficient access to video content is expected to be more challenging than image mining. Previously, we have developed a content-based image retrieval system and the benchmarking framework for personal images. In this paper, we extend our personal image retrieval system to include personal home video clips. A possible initial solution to video mining is to represent video clips by a set of key frames extracted from them thus converting the problem into an image search one. Here we report that a careful selection of key frames may improve the retrieval accuracy. However, because video also has temporal dimension, its key frame representation is inherently limited. The use of temporal information can give us better representation for video content at semantic object and concept levels than image-only based representation. In this paper we propose a bottom-up framework to combine interest point tracking, image segmentation and motion-shape factorization to decompose the video into spatiotemporal regions. We show an example application of activity concept detection using the trajectories extracted from the spatio-temporal regions. The proposed approach shows good potential for concise representation and indexing of objects and their motion in real-life consumer video.

Citation Download Citation

Haoran Yi, Igor Kozintsev, Marzia Polito, Yi Wu, Jean-Yves Bouguet, Ara Nefian, and Carole Dulong "A spatiotemporal decomposition strategy for personal home video management", Proc. SPIE 6506, Multimedia Content Access: Algorithms and Systems, 65060Q (29 January 2007); https://doi.org/10.1117/12.704599

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Feature extraction

Image retrieval

Image segmentation

Sensors

Video surveillance

Motion measurement

Show All Keywords

Keywords/Phrases

Search In:

Publication Years