27 March 2024 Lightweight high-resolution network based on adaptive cross-dimensional weighting for human pose estimation
Fengqin Wang, Hongyang Chen, Zuhe Li, Yanjun Wang, Erlin Tian, Fujiao Ju, Xiangzhou Bu, Hui Chen, Junmin Wang
Author Affiliations +
Abstract

The primary aim of human pose estimation involves accurately identifying key points on the human body, which is integral for various visual applications that require an in-depth understanding of human behavior. While high-resolution networks have excelled in this domain, their limitations, such as inadequate cross-dimensional information interaction and substantial computational costs, have prompted the need for more efficient solutions. To tackle these challenges, we introduce an adaptive cross-dimensional weighting high-resolution network (ACW-HRNet). This improved approach combines two key methods, cross-dimensional split convolution and adaptive context modeling (ACM). Cross-dimensional split convolution establishes effective cross-dimensional information exchange between spatial and channel, whereas ACM enhances the network’s ability to capture intricate spatial relationships through adaptive transformations and spatial weighting of input features. These make the network extract multi-scale context information and establish cross-dimensional dependencies, improving accuracy without introducing additional computational complexity. Our experiments on the COCO, MPII, and CrowdPose human pose estimation datasets illustrate its superior performance compared to mainstream lightweight networks.

© 2024 SPIE and IS&T
Fengqin Wang, Hongyang Chen, Zuhe Li, Yanjun Wang, Erlin Tian, Fujiao Ju, Xiangzhou Bu, Hui Chen, and Junmin Wang "Lightweight high-resolution network based on adaptive cross-dimensional weighting for human pose estimation," Journal of Electronic Imaging 33(2), 023037 (27 March 2024). https://doi.org/10.1117/1.JEI.33.2.023037
Received: 20 December 2023; Accepted: 18 March 2024; Published: 27 March 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Convolution

Pose estimation

Network architectures

Modeling

Design

Sensors

Autoregressive models

RELATED CONTENT


Back to Top