Semi-supervised learning for compound facial expression recognition with basic expression data

Rongkang Dong; Kin-Man Lam

doi:10.1117/12.3018628

2 May 2024 Semi-supervised learning for compound facial expression recognition with basic expression data

Rongkang Dong, Kin-Man Lam

Proceedings Volume 13164, International Workshop on Advanced Imaging Technology (IWAIT) 2024; 131641K (2024) https://doi.org/10.1117/12.3018628
Event: International Workshop on Advanced Imaging Technology (IWAIT) 2024, 2024, Langkawi, Malaysia

Abstract

Automatic facial expression recognition serves as a crucial technique in human-machine interaction. Existing works on facial expression recognition mainly focus on recognizing basic expressions while paying far less attention to compound expressions. Even worse, the scale of compound facial expression data remains small. Labeling compound expression data requires the annotators to be equipped with prior psychological knowledge, and it is a time-consuming and labor-intensive task. Fortunately, large-size labeled basic expression databases are available. As basic expression images can potentially be compound expressions, they can be used for compound facial expression recognition. To achieve this goal, in this work, we propose a semi-supervised learning framework to generate pseudo-compound-emotion labels for basic expression data. This approach aims to increase the number of training data and improve model capability for compound facial expression recognition. Our method further explores leveraging the basic labels by introducing a basic-label smoothing mechanism. Experimental results on the RAF-DB and the EmotioNet compound subset demonstrate significant improvement achieved by the proposed method over the baseline methods.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Rongkang Dong and Kin-Man Lam "Semi-supervised learning for compound facial expression recognition with basic expression data", Proc. SPIE 13164, International Workshop on Advanced Imaging Technology (IWAIT) 2024, 131641K (2 May 2024); https://doi.org/10.1117/12.3018628

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available