Requirements for benchmarking personal image retrieval systems

Jean-Yves Bouguet; Carole Dulong; Igor Kozintsev; Yi Wu

doi:10.1117/12.660254

16 January 2006 Requirements for benchmarking personal image retrieval systems

Jean-Yves Bouguet, Carole Dulong, Igor Kozintsev, Yi Wu

Proceedings Volume 6061, Internet Imaging VII; 606101 (2006) https://doi.org/10.1117/12.660254
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

It is now common to have accumulated tens of thousands of personal ictures. Efficient access to that many pictures can only be done with a robust image retrieval system. This application is of high interest to Intel processor architects. It is highly compute intensive, and could motivate end users to upgrade their personal computers to the next generations of processors. A key question is how to assess the robustness of a personal image retrieval system. Personal image databases are very different from digital libraries that have been used by many Content Based Image Retrieval Systems.¹ For example a personal image database has a lot of pictures of people, but a small set of different people typically family, relatives, and friends. Pictures are taken in a limited set of places like home, work, school, and vacation destination. The most frequent queries are searched for people, and for places. These attributes, and many others affect how a personal image retrieval system should be benchmarked, and benchmarks need to be different from existing ones based on art images, or medical images for examples. The attributes of the data set do not change the list of components needed for the benchmarking of such systems as specified in²: - data sets - query tasks - ground truth - evaluation measures - benchmarking events. This paper proposed a way to build these components to be representative of personal image databases, and of the corresponding usage models.

Citation Download Citation

Jean-Yves Bouguet, Carole Dulong, Igor Kozintsev, and Yi Wu "Requirements for benchmarking personal image retrieval systems", Proc. SPIE 6061, Internet Imaging VII, 606101 (16 January 2006); https://doi.org/10.1117/12.660254

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available