Single image 3D scene reconstruction based on ShapeNet models

Xueyang Chen; Yifan Ren; Yaoxu Song

doi:10.1117/12.2645274

12 October 2022 Single image 3D scene reconstruction based on ShapeNet models

Xueyang Chen, Yifan Ren, Yaoxu Song

Proceedings Volume 12342, Fourteenth International Conference on Digital Image Processing (ICDIP 2022); 1234213 (2022) https://doi.org/10.1117/12.2645274
Event: Fourteenth International Conference on Digital Image Processing (ICDIP 2022), 2022, Wuhan, China

Abstract

The 3D scene reconstruction task is the basis for implementing mixed reality, but traditional single-image scene reconstruction algorithms are difficult to generate regularized models. It is believed that this situation is caused by a lack of prior knowledge, so we try to introduce the model collection ShapeNet ¹ to solve this problem. Besides, our approach incorporates traditional model generation algorithms. The predicted artificial indoor objects as indicators will match models in ShapeNet. The refined models selected from ShapeNet will then replace the rough ones to produce the final 3D scene. These selected models from the model library will greatly improve the aesthetics of the reconstructed 3D scene. We test our method on the NYU-v2 ² dataset and achieve pleasing results. Our project is publicly available at https://sjtu-cv- 2021.github.io/Single-Image-3D-Reconstruction-Based-On-ShapeNet.

Citation Download Citation

Xueyang Chen, Yifan Ren, and Yaoxu Song "Single image 3D scene reconstruction based on ShapeNet models", Proc. SPIE 12342, Fourteenth International Conference on Digital Image Processing (ICDIP 2022), 1234213 (12 October 2022); https://doi.org/10.1117/12.2645274

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

3D modeling

3D image reconstruction

3D image processing

Reconstruction algorithms

Performance modeling

Image segmentation

Statistical modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years