Bayesian surprise metric for outlier detection in on-line learning

Erion Hasanbelliu; Kittipat Kampa; James T. Cobb; José C. Príncipe

doi:10.1117/12.883662

23 May 2011 Bayesian surprise metric for outlier detection in on-line learning

Erion Hasanbelliu, Kittipat Kampa, James T. Cobb, José C. Príncipe

Proceedings Volume 8017, Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XVI; 80170S (2011) https://doi.org/10.1117/12.883662
Event: SPIE Defense, Security, and Sensing, 2011, Orlando, Florida, United States

Abstract

Our previous work developed an online learning Bayesian framework (dynamic tree) for data organization and clustering. To continuously adapt the system during operation, we concurrently seek to perform outlier detection to prevent them from incorrectly modifying the system. We propose a new Bayesian surprise metric to differentiate outliers from the training data and thus help to selectively adapt the model parameters. The metric is calculated based on the difference between the prior and the posterior distributions on the model when a new sample is introduced. A good training datum would sufficiently but not excessively change the model; consequently, the difference between the prior and the posterior distributions would be reasonable to the amount of new information present on the datum. However, an outlier carries an element of surprise that would significantly change the model. In such a case, the posterior distribution would greatly differ from the prior resulting in a large value for the surprise metric. We categorize this datum as an outlier and other means (e.g. human operator) will have to be used to handle such cases. The surprise metric is calculated based on the model distribution, and as such, it adapts with the model. The surprise factor is dependent on the state of the system. This speeds up the learning process by considering only the relevant new data. Both the model parameters and even the structure of the dynamic tree can be updated under this approach.

Citation Download Citation

Erion Hasanbelliu, Kittipat Kampa, James T. Cobb, and José C. Príncipe "Bayesian surprise metric for outlier detection in on-line learning", Proc. SPIE 8017, Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XVI, 80170S (23 May 2011); https://doi.org/10.1117/12.883662

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available