Fair evaluation methods for image watermarking systems
Fair evaluation methods for image watermarking systems
复制标题
DOI：
10.1117/1.1287594
复制
发表时间：
2000-10
期刊：
影响因子：
--
通讯作者：
M. Kutter;F. Petitcolas
中科院分区：
文献类型：
--
作者：
M. Kutter;F. Petitcolas
自20世纪90年代初以来，出现了许多关于“鲁棒”数字水印系统的论文，但它们都没有使用相同的鲁棒性标准。这对于比较来说是不实际的，并且会减缓这一领域的进展。为了解决这个问题，我们提出了一个图像水印系统的评估程序。首先，我们确定所有必要的参数进行适当的基准测试，并研究如何定量描述由水印过程引入的图像退化。在此基础上，分析了传统图像质量度量方法在背景水印中的不足，提出了一种适应人类视觉系统的图像质量度量方法。然后，我们展示了如何有效地评估水印性能，使不同方法之间的公平比较成为可能。三个图表的有用性：“攻击与视觉质量，‘’ ‘’误码与视觉质量，”和“误码与攻击”进行了调查。此外，回顾并提出了用于描述水印方法统计检测行为的接收机工作特征图。最后，我们回顾了一些攻击，任何系统都应该幸存下来，真正有用，并提出了一个基准和一组不同的合适的图像。©2000 SPIE and IS&T。(s1017 - 9909 (00) 00604 - 8)
Since the early 1990s a number of papers on ''robust'' digital watermarking systems have been presented but none of them uses the same robustness criteria. This is not practical at all for comparison and slows down progress in this area. To address this issue, we present an evaluation procedure of image watermark- ing systems. First we identify all necessary parameters for proper benchmarking and investigate how to quantitatively describe the im- age degradation introduced by the watermarking process. For this, we show the weaknesses of usual image quality measures in the context watermarking and propose a novel measure adapted to the human visual system. Then we show how to efficiently evaluate the watermark performance in such a way that fair comparisons be- tween different methods are possible. The usefulness of three graphs: ''attack versus visual-quality,'' ''bit error versus visual qual- ity,'' and ''bit error versus attack'' are investigated. In addition the receiver operating characteristic graphs are reviewed and proposed to describe statistical detection behavior of watermarking methods. Finally we review a number of attacks that any system should sur- vive to be really useful and propose a benchmark and a set of dif- ferent suitable images. © 2000 SPIE and IS&T. (S1017-9909(00)00604-8)