Method of student identification through college classroom surveillance videos using deep learning features and label propagation

Bo Sun; Bojie Rong; Jun He

doi:10.1117/12.2284886

24 October 2017 Method of student identification through college classroom surveillance videos using deep learning features and label propagation

Bo Sun, Bojie Rong, Jun He

Author Affiliations +

Proceedings Volume 10462, AOPC 2017: Optical Sensing and Imaging Technology and Applications; 104622L (2017) https://doi.org/10.1117/12.2284886
Event: Applied Optics and Photonics China (AOPC2017), 2017, Beijing, China

Abstract

For education or management, it is often necessary to identify students with their identification (ID) photos through the surveillance videos of the college classrooms. This is a typical application of ID photo based single-sample per-person (SSPP-ID) face recognition. After analyzing the main challenges, we propose a framework by combining deep learning method and label propagation algorithm together. It is composed of three sequential steps: the first step aims to partition the face image into several patches and get an unbalanced-patch based feature using ConvNets; In the second step, we select a few key-frames by using the log-likelihood ratio calculated by the Joint Bayesian model; The last step uses label propagation algorithm to propagate the labels from the key frames to the whole video by simultaneously incorporating constraints in temporal and feature spaces. The performance of the proposed method is evaluated on Movie Trailer Face Dataset and practical college class surveillance videos. Experiments with these challenging datasets validate the utility of the proposed method.

Citation Download Citation

Bo Sun, Bojie Rong, and Jun He "Method of student identification through college classroom surveillance videos using deep learning features and label propagation", Proc. SPIE 10462, AOPC 2017: Optical Sensing and Imaging Technology and Applications, 104622L (24 October 2017); https://doi.org/10.1117/12.2284886

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available