Dynamic 3D face acquisition based on feature points matching and active binocular vision

Jiandong Zhan; Yong Li; Liangbo He; Tongzan Liu; Shutian Xu; Xiaosong Zhang

doi:10.1117/12.2667030

27 January 2023 Dynamic 3D face acquisition based on feature points matching and active binocular vision

Jiandong Zhan, Yong Li, Liangbo He, Tongzan Liu, Shutian Xu, Xiaosong Zhang

Proceedings Volume 12550, International Conference on Optical and Photonic Engineering (icOPEN 2022); 1255008 (2023) https://doi.org/10.1117/12.2667030
Event: International Conference on Optical and Photonic Engineering (icOPEN 2022), 2022, ONLINE, China

Abstract

ynamic 3D face acquisition has been widely used in the fields of real-time expression capture, face recognition, plastic surgery and film entertainment. High-precision 3D shape can be obtained by fringe projection 3D measurement technology. However, the phase ambiguity is one of the key issues must be solved. According to the features of human face, a method based on feature point matching and active binocular vision is proposed to address this problem. The specific method is as follows: 1) Project three sinusoidal fringes with a phase difference of 2π/3. Capture the deformed fringes by the left and right cameras simultaneously. 2) According to the phase shift method, calculate the corresponding intensity images and the wrapping phase maps from the deformed fringes captured by the left and right cameras respectively. 3) Detect the face feature points in the left and right intensity images respectively. 4) Create the rough face disparity map by matching the feature points of human face in the left and right intensity images. 5) On the basis of rough disparity map, obtain the dense and high-precision disparity map by directly matching the wrapping phase of the left and right images. And then reconstruct the 3D face. Compared with the traditional method, the proposed method does not need the spatial phase unwrapping, nor does it need the projection of additional patterns to assist the phase unwrapping, which shortens the acquisition time while ensuring the measurement reliability. A DLP projector and two cameras with resolution of 1.3 megapixels and speed of 210fps were used to build an experimental system to verify the proposed method. The experimental results show that the proposed method is robust and the 3D face acquisition speed reaches 70fps.

Citation Download Citation

Jiandong Zhan, Yong Li, Liangbo He, Tongzan Liu, Shutian Xu, and Xiaosong Zhang "Dynamic 3D face acquisition based on feature points matching and active binocular vision", Proc. SPIE 12550, International Conference on Optical and Photonic Engineering (icOPEN 2022), 1255008 (27 January 2023); https://doi.org/10.1117/12.2667030

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

3D acquisition

Cameras

Phase unwrapping

3D metrology

Feature extraction

3D modeling

Deformation

Show All Keywords

Keywords/Phrases

Search In:

Publication Years