Two novel motion-based algorithms for surveillance video analysis on embedded platforms

Julien A. Vijverberg; Marijn J. H. Loomans; Cornelis J. Koeleman; Peter H. N. de With

doi:10.1117/12.851371

4 May 2010 Two novel motion-based algorithms for surveillance video analysis on embedded platforms

Julien A. Vijverberg, Marijn J. H. Loomans, Cornelis J. Koeleman, Peter H. N. de With

Proceedings Volume 7724, Real-Time Image and Video Processing 2010; 77240I (2010) https://doi.org/10.1117/12.851371
Event: SPIE Photonics Europe, 2010, Brussels, Belgium

Abstract

This paper proposes two novel motion-vector based techniques for target detection and target tracking in surveillance videos. The algorithms are designed to operate on a resource-constrained device, such as a surveillance camera, and to reuse the motion vectors generated by the video encoder. The first novel algorithm for target detection uses motion vectors to construct a consistent motion mask, which is combined with a simple background segmentation technique to obtain a segmentation mask. The second proposed algorithm aims at multi-target tracking and uses motion vectors to assign blocks to targets employing five features. The weights of these features are adapted based on the interaction between targets. These algorithms are combined in one complete analysis application. The performance of this application for target detection has been evaluated for the i-LIDS sterile zone dataset and achieves an F1-score of 0.40-0.69. The performance of the analysis algorithm for multi-target tracking has been evaluated using the CAVIAR dataset and achieves an MOTP of around 9.7 and MOTA of 0.17-0.25. On a selection of targets in videos from other datasets, the achieved MOTP and MOTA are 8.8-10.5 and 0.32-0.49 respectively. The execution time on a PC-based platform is 36 ms. This includes the 20 ms for generating motion vectors, which are also required by the video encoder.

Citation Download Citation

Julien A. Vijverberg, Marijn J. H. Loomans, Cornelis J. Koeleman, and Peter H. N. de With "Two novel motion-based algorithms for surveillance video analysis on embedded platforms", Proc. SPIE 7724, Real-Time Image and Video Processing 2010, 77240I (4 May 2010); https://doi.org/10.1117/12.851371

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available