KEYWORDS: 3D modeling, RGB color model, 3D image reconstruction, Data transmission, Image restoration, Convolution, Virtual reality, Transformers, Feature extraction, 3D image processing
In recent years, with the rapid development of the artificial intelligence technology, many computer vision applications have been proposed, including Virtual Reality (VR), Augmented Reality (AR), and the metaverse. One of the key technologies to realize these vision applications is "human 3D mesh reconstruction." This paper aims to research the task of reconstructing human 3D mesh model from a single RGB image, with a focus on achieving good reconstruction results while reducing computational costs, thereby establishing advantages for future daily life applications. We propose an improved version of the HyperGraph Convolution Network (HGCN), called the Swift HyperGraph Convolution Network (Swift-HGCN), which allows for faster transmission of information across different parts of the human mesh model. Additionally, we apply the Mamba module to address the high computational complexity caused by the self-attention mechanism in Transformers, while still maintaining good accuracy. Moreover, our system analyzes multi-scale image features and perform multi-stage refinement to reduce reconstruction errors. In the experimental results, our method showed an average vertex position error that is 1.3mm higher than a baseline method, but used only 86.5% of the parameters and had just 17.3% of the computational complexity. This demonstrates that our approach is more suitable for environments with limited computational resources, such as embedded systems.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.