Learning Bayesian network parameters from imperfect data: enhancements to the EM algorithm

Rohitha Hewawasam; Kamal Premaratne

doi:10.1117/12.719290

30 April 2007 Learning Bayesian network parameters from imperfect data: enhancements to the EM algorithm

Rohitha Hewawasam, Kamal Premaratne

Proceedings Volume 6560, Intelligent Computing: Theory and Applications V; 65600E (2007) https://doi.org/10.1117/12.719290
Event: Defense and Security Symposium, 2007, Orlando, Florida, United States

Abstract

The recent years have seen many developments in uncertainty reasoning taking place around Bayesian Networks (BNs). BNs allow fast and efficient probabilistic reasoning. One of the key issues that researchers have faced in using a BN is determining its parameters and structure for a given problem. Many techniques have been developed for learning BN parameters from a given dataset pertaining to a particular problem. Most of the methods developed for learning BN parameters from partially observed data have evolved around the Expectation-Maximization (EM) algorithm. In its original form, EM algorithm is a deterministic iterative two-step procedure that converges towards the maximum-likelihood (ML) estimates. The EM algorithm mainly focuses on learning BN parameters from imperfect data where some of the values are missing. However in many practical applications, partial observability results in a wider range of imperfections, e.g., uncertainties arising from incomplete, ambiguous, probabilistic, and belief theoretic data. Moreover, while convergence is to their ML estimates, the EM algorithm does not guarantee convergence to the underlying true parameters. In this paper, we propose an approach that enables one to learn BN parameters from a dataset containing a wider variety of imperfections. In addition, by introducing an early stopping criterion together with a new initialization method to the EM-algorithm, we show how the BN parameters could be learnt so that they are closer to the underlying true parameters than the converged ML estimated parameters.

Citation Download Citation

Rohitha Hewawasam and Kamal Premaratne "Learning Bayesian network parameters from imperfect data: enhancements to the EM algorithm", Proc. SPIE 6560, Intelligent Computing: Theory and Applications V, 65600E (30 April 2007); https://doi.org/10.1117/12.719290

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available