Optimization of 3D light field display by neural network based image deconvolution algorithm

Parsa Omidi; Mahdi Safari; Simon Thibault; Herman M. K. Wong

doi:10.1117/12.2647892

14 March 2023 Optimization of 3D light field display by neural network based image deconvolution algorithm

Parsa Omidi, Mahdi Safari, Simon Thibault, Herman M. K. Wong

Proceedings Volume 12443, Advances in Display Technologies XIII; 124430K (2023) https://doi.org/10.1117/12.2647892
Event: SPIE OPTO, 2023, San Francisco, California, United States

Conference Poster

Abstract

Three-dimensional Light Field Displays (LFDs) promise to provide realistic and comfortable viewing for one or multiple users simultaneously without any eyewear by overcoming the vergence-accommodation conflict. However, LFDs have not yet gained widespread adoption and remain a hot topic of research. Currently, LFDs are based on refractive Microlens Array (MLA) optics, which have inherent limitations including high optical aberrations and/or bulkiness. Metasurfaces are flat optics made of a distribution of subwavelength size nanopillars that can manipulate light wave properties including phase, amplitude, and polarization and be fabricated in a single lithographic step. They can be used as a more compact alternative to refractive MLAs. However, current designs cannot achieve comparable full-color and wide field-of-view imaging by multiple layers of refractive lenses. In this work, we demonstrate a deconvolution neural network model based on the U-Net architecture and Wiener non-blind deconvolution that reduces the effects of aberrations caused by a designed metasurface, enabling high image quality 3D LFDs. We employ an analytical model to determine the metasurface phase profile and point spread function for a five-by-five view LFD scenario. Our model is trained and evaluated using 52 images of 8.1 megapixels each from online databases of multiview images. To minimize the spatially varying aberration effects, a loss function is used that incorporates spatial pixel-wise error, structural quality, and angular consistency. Compared to the output images without preprocessing images using the designed PSFs, our neural network model improved PSNR by 10 dB and MS-SSIM by 2% overall for all views and reduced variations between different views by 40% and 70%, respectively, for PSNR and MS-SSIM.

Citation Download Citation

Parsa Omidi, Mahdi Safari, Simon Thibault, and Herman M. K. Wong "Optimization of 3D light field display by neural network based image deconvolution algorithm", Proc. SPIE 12443, Advances in Display Technologies XIII, 124430K (14 March 2023); https://doi.org/10.1117/12.2647892

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available