Faces as light probes for relighting

Hyunjung Shim

doi:10.1117/1.OE.51.7.077002

5 July 2012 Faces as light probes for relighting

Hyunjung Shim

Author Affiliations +

Optical Engineering, Vol. 51, Issue 7, 077002 (July 2012). https://doi.org/10.1117/1.OE.51.7.077002

Abstract

A light probe is commonly used for measuring the illumination of a real scene. Instead of equipping a man-made light probe such as a mirror ball, we propose to use a face in images as a natural light probe. To that end, we construct a statistical reflectance model for faces and use this model to extract the lighting and the reflectance field of an input face. With an iterative procedure, we can obtain the lighting condition from an unknown face image. As a byproduct of this procedure, we also estimate the reflectance field of the same face. By identifying the lighting condition of scene, we can provide an effective solution for various practical applications. First, we can insert a virtual object seamlessly into a real scene by illuminating the virtual object under the lighting present in the real scene. Second, we can relight a face under an arbitrary lighting condition using the estimated reflectance fields. Third, we can swap two unknown faces using the estimates of both lighting and reflectance fields. Based on various experiments, we show that the proposed algorithm is an effective tool for many practical applications: inserting a virtual object into a real scene, face relighting, and face swapping.

Citation Download Citation

Hyunjung Shim "Faces as light probes for relighting," Optical Engineering 51(7), 077002 (5 July 2012). https://doi.org/10.1117/1.OE.51.7.077002

Published: 5 July 2012

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available