On benchmarking content-based image retrieval applications

Yuanyuan Zuo; Jinhui Yuan; Dayong Ding; Dong Wang; Bo Zhang

doi:10.1117/12.660260

16 January 2006 On benchmarking content-based image retrieval applications

Yuanyuan Zuo, Jinhui Yuan, Dayong Ding, Dong Wang, Bo Zhang

Proceedings Volume 6061, Internet Imaging VII; 606106 (2006) https://doi.org/10.1117/12.660260
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

Constructing a benchmark for content-based image retrieval (CBIR) applications is an important task because researchers in this area highly depend on experiments to compare different systems. Image collection, concept annotation and performance evaluation are the three main issues that should be considered carefully. Based on our previous work and experiments on both Corel image collection and TRECVID dataset, we present some basic principles of constructing a benchmark for CBIR applications. According to our experience in the collaborative annotation of TRECVID 2005 data, we propose a hierarchical concept annotation strategy to produce ground truth for the CBIR benchmark image collection. To address the conflicts among collaborative annotations from multiple annotators, we present a fuzzy annotation method, in which a membership function is defined to indicate the probability that an image contains a given concept. Evaluation criteria corresponding to the fuzzy annotation method are also presented so as to give a more reasonable evaluation of performance for different CBIR applications.

Citation Download Citation

Yuanyuan Zuo, Jinhui Yuan, Dayong Ding, Dong Wang, and Bo Zhang "On benchmarking content-based image retrieval applications", Proc. SPIE 6061, Internet Imaging VII, 606106 (16 January 2006); https://doi.org/10.1117/12.660260

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Image retrieval

Content based image retrieval

Multimedia

Semantic video

RGB color model

Databases

Show All Keywords

Keywords/Phrases

Search In:

Publication Years