Video frame rate up conversion under inconsistent camera

Jinsong Wang; Nilesh Patel; William Grosky

doi:10.1117/12.643338

19 January 2006 Video frame rate up conversion under inconsistent camera

Jinsong Wang, Nilesh Patel, William Grosky

Proceedings Volume 6077, Visual Communications and Image Processing 2006; 60771Z (2006) https://doi.org/10.1117/12.643338
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

In this paper, we address the problem of video frame rate up conversion (FRC) in compressed domain. FRC is often recognized as video temporal interpolation. The problem is very challenging when targeted for a video sequence with an inconsistent camera and object motion. A novel compressed domain motion compensation scheme is presented and applied in this paper. The proposed algorithm uses MPEG-2 compressed motion vectors to undergo a cumulative spatiotemporal interpolation over a temporal sliding window of frames. An iterative rejection scheme based on the affine motion model is exploited to detect the global camera motion. Subsequently, the foreground object separation is performed by examining the temporal consistency of the output of iterative rejections. This consistency check process helps to conglomerate the resulting foreground macroblocks and weeds out the unqualified blocks, thus further refines the crude segmentation results. Finally, different strategies for compensating the camera motion and the object motion are applied to interpolate the new frames. Illustrative examples are provided to demonstrate the efficacy of the proposed approach. Experimental results are compared with the popular block based frame interpolation approach.

Citation Download Citation

Jinsong Wang, Nilesh Patel, and William Grosky "Video frame rate up conversion under inconsistent camera", Proc. SPIE 6077, Visual Communications and Image Processing 2006, 60771Z (19 January 2006); https://doi.org/10.1117/12.643338

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Cameras

Motion estimation

Motion models

Video compression

Video processing

3D modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years