Multistage cascade method for dangerous assembly behavior recognition in machine tools

Junyao Lin; Ping Yan; Yingtao Su

doi:10.1117/12.3034746

11 July 2024 Multistage cascade method for dangerous assembly behavior recognition in machine tools

Junyao Lin, Ping Yan, Yingtao Su

Proceedings Volume 13210, Third International Symposium on Computer Applications and Information Systems (ISCAIS 2024); 132102O (2024) https://doi.org/10.1117/12.3034746
Event: Third International Symposium on Computer Applications and Information Systems (ISCAIS 2023), 2024, Wuhan, China

Abstract

In the process of recognizing dangerous assembly behavior in machine tools, there are challenges such as the difficulty of behavior interval calibration and the limited feature discrimination ability of existing recognition models. To address these challenges, a cascade network method for dangerous assembly behavior recognition is proposed. First, this paper proposes the behavior category hypothesis module, dual-channel structures with different sampling frame rates were used to learn human action features with spatio-temporal semantic information, providing supervised behavior category labels for the fine-grained classification in the second stage; Secondly, this paper constructs the behavior information detection module and incorporates a target and attitude detection phase based on the results obtained from the first stage. This is achieved by capturing key behavioral information features that influence the discrimination of behaviors in video through FPN and PAN structures; Finally, the stage decision algorithm of the behavior definition module realizes the multimodal feature fusion of human action and behavior information, and then the rapid decision of dangerous assembly behavior. The CART decision tree algorithm is used to construct the feature weighting structure, which improves the accuracy of dangerous assembly behavior recognition. Experiments show that the proposed method can reach 93.6% accuracy with good accuracy and robustness.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Junyao Lin, Ping Yan, and Yingtao Su "Multistage cascade method for dangerous assembly behavior recognition in machine tools", Proc. SPIE 13210, Third International Symposium on Computer Applications and Information Systems (ISCAIS 2024), 132102O (11 July 2024); https://doi.org/10.1117/12.3034746

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available