A method to characterize dataset based on objective rule evaluation indices

Hidenao Abe; Shusaku Tsumoto

doi:10.1117/12.820319

13 April 2009 A method to characterize dataset based on objective rule evaluation indices

Hidenao Abe, Shusaku Tsumoto

Proceedings Volume 7344, Data Mining, Intrusion Detection, Information Security and Assurance, and Data Networks Security 2009; 73440D (2009) https://doi.org/10.1117/12.820319
Event: SPIE Defense, Security, and Sensing, 2009, Orlando, Florida, United States

Abstract

Data characterizing techniques have been developed to control learning algorithm selection by using statistical measurements of a dataset. To expand the framework of meta-learning, it is important to consider results of other learning algorithms. Therefore, we consider about a method to reuse objective rule evaluation indices of classification rules. Objective rule evaluation indices such as support, precision and recall are calculated by using a rule set and a validation dataset. This data-driven approach is often used to filter out not useful rules from obtained rule set by a rule learning algorithm. At the same time, these indices can detect differences between two validation datasets by using the rule set and the indices, because the definitions of indices independent on both of a rule and a dataset. In this paper, we present a method to characterize given datasets based on objective rule evaluation indices by using differences of correlation coefficients between each index. By comparing the differences, we describe the results of similar/dissimilar groups of the datasets.

Citation Download Citation

Hidenao Abe and Shusaku Tsumoto "A method to characterize dataset based on objective rule evaluation indices", Proc. SPIE 7344, Data Mining, Intrusion Detection, Information Security and Assurance, and Data Networks Security 2009, 73440D (13 April 2009); https://doi.org/10.1117/12.820319

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available