Correction of lighting effects in diminished reality for concealing light equipment

Seiya Kudo; Yoshitsugu Manabe; Noriko Yata

doi:10.1117/12.3057824

5 February 2025 Correction of lighting effects in diminished reality for concealing light equipment

Seiya Kudo, Yoshitsugu Manabe, Noriko Yata

Author Affiliations +

Proceedings Volume 13510, International Workshop on Advanced Imaging Technology (IWAIT) 2025; 135100M (2025) https://doi.org/10.1117/12.3057824
Event: International Workshop on Advanced Imaging Technology (IWAIT) 2025, 2025, Douliu City, Taiwan

Abstract

Diminished Reality (DR) is a technology that conceals real-world objects by blending them with background information. This technology has applications in various fields, including simulating furniture arrangements at home before purchase. In such a system, existing furniture is first concealed using DR, and then new virtual furniture is displayed onto the concealed scene using Augmented Reality (AR). This allows users to visualize how new furniture will look in their home, even in spaces where items are already placed, therefore it makes it easier to make informed purchasing decisions. However, existing approaches are difficult to accurately account for and correct the environmental effects of concealed objects, particularly those that influence lighting, such as light equipment. This study proposes a method to not only conceal light equipment within a scene but also to correct the associated lighting effects, and it enhances the realism of the DR process. The method first estimates the light source’s 3D position using depth information captured by an RGB-D camera and applies a brightness correction based on the estimated position and its distance from the light source. Then, Generative Adversarial Network (GAN) is used to perform the DR process and conceal the light equipment effectively within the corrected image. The results show that applying the proposed brightness correction reduces the inconsistency in lighting effects and leads to a more realistic concealment of the light equipment and improves the overall visual quality of the scene.

(2025) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Seiya Kudo, Yoshitsugu Manabe, and Noriko Yata "Correction of lighting effects in diminished reality for concealing light equipment", Proc. SPIE 13510, International Workshop on Advanced Imaging Technology (IWAIT) 2025, 135100M (5 February 2025); https://doi.org/10.1117/12.3057824

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Light sources

Light sources and illumination

Image processing

Augmented reality

Cameras

Shadows

3D image processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years