Method for comparing content-based image retrieval methods

Kobus Barnard; Nikhil V. Shirahatti

doi:10.1117/12.476179

10 January 2003 Method for comparing content based image retrieval methods

Kobus Barnard, Nikhil V. Shirahatti

Proceedings Volume 5018, Internet Imaging IV; (2003) https://doi.org/10.1117/12.476179
Event: Electronic Imaging 2003, 2003, Santa Clara, CA, United States

Abstract

We assume that the goal of content based image retrieval is to find images which are both semantically and visually relevant to users based on image descriptors. These descriptors are often provided by an example image--the query by example paradigm. In this work we develop a very simple method for evaluating such systems based on large collections of images with associated text. Examples of such collections include the Corel image collection, annotated museum collections, news photos with captions, and web images with associated text based on heuristic reasoning on the structure of typical web pages (such as used by Google(tm)). The advantage of using such data is that it is plentiful, and the method we propose can be automatically applied to hundreds of thousands of queries. However, it is critical that such a method be verified against human usage, and to do this we evaluate over 6000 query/result pairs. Our results strongly suggest that at least in the case of the Corel image collection, the automated measure is a good proxy for human evaluation. Importantly, our human evaluation data can be reused for the evaluation of any content based image retrieval system and/or the verification of additional proxy measures.

Citation Download Citation

Kobus Barnard and Nikhil V. Shirahatti "Method for comparing content based image retrieval methods", Proc. SPIE 5018, Internet Imaging IV, (10 January 2003); https://doi.org/10.1117/12.476179

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available