Camera model compensation for image integration of time-of-flight depth video and color video

Hiromu Yamashita; Shogo Tokai; Shunpei Uchino

doi:10.1117/12.2083485

17 March 2015 Camera model compensation for image integration of time-of-flight depth video and color video

Hiromu Yamashita, Shogo Tokai, Shunpei Uchino

Proceedings Volume 9393, Three-Dimensional Image Processing, Measurement (3DIPM), and Applications 2015; 93930F (2015) https://doi.org/10.1117/12.2083485
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

In this paper, we describe a consideration of a method of a camera calibration for TOF depth camera in the case of using with color video camera to combine their images into colored 3D models of a scene. Mainly, there are two problems with the calibration to combine them. One is stability of the TOF measurements, and another is deviation between the measured depth values and actual distances that are based on a geometrical camera model. To solve them, we propose a calibration method for it. At first, we estimate an optimum offset distance and intrinsic parameters for the depth camera to match both the measured depth value and its ideal one. Using estimated offset to consecutive frames and compensating the measured values to the actual distance values each frame, we try to remove the difference of camera models and suppress the noise as temporal variation For the estimation, we used the Zhang’s calibration method for the intensity image from the depth camera and the color video image of a chessboard pattern. Using this method, we can get the 3D models which are matched between depth and color information correctly and stably. We also explain effectiveness of our approach by showing several experimental results.

Citation Download Citation

Hiromu Yamashita, Shogo Tokai, and Shunpei Uchino "Camera model compensation for image integration of time-of-flight depth video and color video", Proc. SPIE 9393, Three-Dimensional Image Processing, Measurement (3DIPM), and Applications 2015, 93930F (17 March 2015); https://doi.org/10.1117/12.2083485

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available