CPA -G&V: Collaborative Research: Visual Equivalence: a New Foundation for Perceptually-Based Rendering of Complex Scenes

摘要PI：Kavita巴拉（0811680）逼真成像的目标是产生忠实地代表真实的世界的外观的图像。 评估图像保真度是真实感成像的一个重要方面，在计算机图形学和数字摄影中具有广泛的意义。 最近，基于人类视觉的计算模型的感知度量已被用于表征图像保真度，但这些度量通常表征逐像素图像差异。当我们看图像时，我们不？我们看不到像素，我们看到的是具有不同形状、大小、材质和运动的物体。 因此，需要表征对象的外观属性的图像保真度度量。这个项目引入了一个新的图像保真度标准，称为视觉等效。如果图像传达了关于对象外观（形状，材料，照明）的相同信息，即使它们逐像素不同，则图像在视觉上是等效的。这个新标准从根本上扩展了如何评估图像保真度的范围，提供了一个基于视觉编码的更高级别属性的度量标准。该项目旨在通过以下方式理解和利用视觉等效现象：a）进行一系列心理物理实验，通过探索几何形状之间的相互作用，B）开发适用于大范围场景的视觉等效预测器;以及c）展示视觉等效概念在一系列应用中的实际效用，包括高逼真的环境地图压缩和复杂场景的可伸缩渲染。这项研究的产品提供了有价值的新工具，以解决计算机图形学的巨大挑战之一：高性能，高保真度的复杂场景的图像合成。 此外，这种新的图像保真度的方法应该有一个显着的影响，包括2d和3d数字图像采集，编码，压缩，传输，存储和显示领域超越图形。

AbstractPI: Kavita Bala (0811680)The goal of realistic imaging is to produce images that faithfully represent the appearance of the real world. Assessing image fidelity is an important aspect of realistic imaging that has broad implications in both computer graphics and digital photography. Recently perceptual metrics based on computational models of human vision have been used to characterize image fidelity; but these metrics typically characterize pixel-wise image differences. When we look at images we don?t see pixels, we see objects with distinct shapes, sizes, materials, and motions. Therefore, there is a need for image fidelity metrics that characterize the appearance properties of objects. This project introduces a new standard for image fidelity called visual equivalence. Images are visually equivalent if they convey the same information about object appearance (shape, material, lighting), even if they are different pixel-by-pixel. This new standard fundamentally expands the scope of how to assess image fidelity, providing a metric that is based on higher-level properties of visual coding.This project seeks to understand and leverage the phenomenon of visual equivalence by: a) conducting a series of psychophysical experiments that develop a foundation for visual equivalence by exploring interactions between the geometry, material and illumination properties of objects in complex scenes; b) developing visual equivalence predictors that apply to a wide range of scenes; and c) demonstrating the practical utility of the concept of visual equivalence in a range of applications including high-fidelity environment map compression and scalable rendering of complex scenes. The products of this research provide valuable new tools for addressing one of the grand challenges in computer graphics: the high performance, high fidelity image synthesis of complex scenes. Further, this new approach to image fidelity should have a significant impact beyond graphics in areas including 2d and 3d digital image acquisition, coding, compression, transmission, storage, and display.