Fair evaluation methods for image watermarking systems

Martin Kutter; Fabien A. P. Petitcolas

doi:10.1117/1.1287594

1 October 2000 Fair evaluation methods for image watermarking systems

Journal of Electronic Imaging, Vol. 9, Issue 4, (October 2000). https://doi.org/10.1117/1.1287594

Since the early 1990s a number of papers on ‘‘robust’’ digital watermarking systems have been presented but none of them uses the same robustness criteria. This is not practical at all for comparison and slows down progress in this area. To address this issue, we present an evaluation procedure of image watermarking systems. First we identify all necessary parameters for proper benchmarking and investigate how to quantitatively describe the image degradation introduced by the watermarking process. For this, we show the weaknesses of usual image quality measures in the context watermarking and propose a novel measure adapted to the human visual system. Then we show how to efficiently evaluate the watermark performance in such a way that fair comparisons between different methods are possible. The usefulness of three graphs: ‘‘attack versus visual-quality,’’ ‘‘bit error versus visual quality,’’ and ‘‘bit error versus attack’’ are investigated. In addition the receiver operating characteristic graphs are reviewed and proposed to describe statistical detection behavior of watermarking methods. Finally we review a number of attacks that any system should survive to be really useful and propose a benchmark and a set of different suitable images.

Citation Download Citation

Martin Kutter and Fabien A. P. Petitcolas "Fair evaluation methods for image watermarking systems," Journal of Electronic Imaging 9(4), (1 October 2000). https://doi.org/10.1117/1.1287594

Published: 1 October 2000

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available