Using specific evaluation for comparing and combining competing algorithms: applying it to table column detection

Ana Costa e Silva

doi:10.1117/12.910544

23 January 2012 Using specific evaluation for comparing and combining competing algorithms: applying it to table column detection

Ana Costa e Silva

Author Affiliations +

Proceedings Volume 8297, Document Recognition and Retrieval XIX; 82970C (2012) https://doi.org/10.1117/12.910544
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

It is a commonly used evaluation strategy to run competing algorithms on a test dataset and state which performs better in average on the whole set. We call this generic evaluation. Although it is important, we believe this type of evaluation is incomplete. In this paper, we propose a methodology for algorithm comparison, which we call specific evaluation. This approach attempts to identify subsets of the data where one algorithm is better than the other. This allows not only knowing each algorithm's strengths and weaknesses better but also constitutes a simple way to develop a combination policy that allows enjoying the best of both. We shall be applying specific evaluation to an experiment that aims at grouping pre-obtained table cells into columns; we demonstrate how it identifies a subset of data for which the on-average least good but faster algorithm is equivalent or better, and how it then manages to create a policy for combining the two competing table column delimitation algorithms.

Citation Download Citation

Ana Costa e Silva "Using specific evaluation for comparing and combining competing algorithms: applying it to table column detection", Proc. SPIE 8297, Document Recognition and Retrieval XIX, 82970C (23 January 2012); https://doi.org/10.1117/12.910544

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available