Illuminating Colour Constancy: from Physics to Photography

在日常生活中，我们依赖于代表真实的世界的彩色图像，从重要个人事件的照片到可能购买的照片。一般来说，这些都是对真实的事物的拙劣近似。我们的目标是更好地理解我们如何感知真实的世界中的颜色，以及如何用图像重建这种感知。这些目标的核心是颜色恒常性，这是一种基本现象，即使在照明颜色发生很大变化的情况下，也能保持物体颜色稳定--无论是在蓝色日光下还是在黄色钨丝灯下，我们都能看到苹果是红色的。照相机传感器忠实地记录变化的光信号，但不自然地具有颜色恒定性。但数码相机通常配备有特殊的色彩平衡模块，以科普光线的变化，它们产生的照片可能会进一步处理，以消除偏色。在计算机视觉中，这种“颜色校正”算法是必要的，使机器能够使用颜色作为可靠的线索-例如，在瓷砖等制成品的自动分级中。人类视觉和计算机视觉通常是相互孤立地研究的：第一个目的是了解为什么颜色会像人类一样出现，另一个目的是使它们对机器尽可能有用，无论它们如何出现。这两个目标通常是不相同的，因为人类和计算机的颜色恒定性都不是完美的。为了将颜色恒定性从人类连接到机器，我们将进行一系列创新的实验。首先，我们将系统地研究光源同色异谱。同色异谱是使所有图像复制工作的原因：两种具有截然不同色谱的刺激物可以引起相同的颜色感受。在电视上引起白色光反射的光具有高度尖峰光谱，而在日光下一张白色纸的光谱反射率是平坦的。然而，当照在白色纸上时看起来相同的光源有时会使其他表面改变外观。当我们购买的衣服在商店人造灯光下看起来很漂亮，但当我们把它们带到户外时就不那么令人满意时，我们就会遇到这种现象。我们将量化这种效果的真实的场景下的真实的灯光使用一种新的'可调'光谱照明器，我们可以产生任何光谱。我们的第二项创新是利用新推出的高动态范围（HDR）显示器。与场景中最亮的点可能是最暗点的100000倍的真实的世界相反，大多数显示器努力产生甚至1000：1的动态范围，而打印照片最多为100：1。然而，我们知道颜色感知取决于场景的整体动态范围。新的HDR显示器可以输出100000：1的对比度，我们将使用它们来测量实验室条件下的恒定性，但具有真实的世界亮度。我们在制作彩色照片时所面临的第三个挑战是我们对真实的世界的感知是不准确的颜色记忆。通常，当我们观看一张照片时，我们没有真实的东西来与之比较，而是必须从记忆中回忆起原始的场景。我们记忆的缺陷可能会影响我们的判断。众所周知，我们对熟悉物体的记忆颜色，如天空、草地和皮肤，往往是“过饱和”的--草地可能比实际上更绿，天空可能比实际上更蓝。因此，当我们通过询问人们他们更喜欢哪种图像来测试颜色校正算法时，我们可能会发现他们不喜欢最准确地再现原始场景的图像，而是匹配他们不完美的记忆。我们将量化记忆和偏好的这些影响。最后，我们的研究将在所有阶段考虑如何通过数学模型预测测量的颜色感知。最终，我们将设计算法来像我们一样自动看到颜色，从而获得更好的照片和更有用的视觉机器。

In daily life, we depend on colour images which represent the real world, from photographs of key personal events to pictures of possible purchases. In general, these are poor approximations of the real thing. Our aim is to understand better how we perceive colours in the real world, and how to recreate that perception with images. Central to these aims is colour constancy, a fundamental phenomenon which keeps object colours stable even under large changes in the colour of the illumination - we see an apple as red whether it is under bluish daylight or yellowish tungsten light. Camera sensors, which faithfully record the changing light signals, do not naturally possess colour constancy. But digital cameras are often equipped with special colour balancing modules to cope with changes in lighting, and the photographs they produce may be further processed to remove colour casts. In computer vision, such 'color correction' algorithms are necessary to enable machines to use colour as a reliable cue - for example, in automated grading of manufactured goods such as tiles. Human vision and computer vision are typically studied in isolation from each other: the first aims to understand why colours appear as they do to humans, and the other to make them as useful as possible to machines, regardless of how they appear. These two goals are generally not identical, because neither human nor computer colour constancy is perfect.To bridge colour constancy from humans to machines we will perform an innovative set of experiments. First, we will systematically study illuminant metamerism. Metamerism is what makes all image reproduction work: two stimuli with vastly different colour spectra can induce the same colour percept. The light invoking a white percept on a TV has a highly spiky spectrum compared to the flat spectral reflectance of a piece of white paper in daylight. Yet, illuminants which look the same when shining on white paper can sometimes make other surfaces change appearance. We experience this phenomenon when we buy clothes which look good under the artificial shop lights but less satisfactory when we take them outdoors. We will quantify this effect for real scenes under real lights using a new 'tuneable' spectral illuminator with which we can generate any light spectrum. Our second innovation is to make use of newly available High-Dynamic-Range (HDR) displays. In contradistinction to the real world where the brightest point in the scene may be a 100000 times as bright as the darkest point, most displays struggle to produce a dynamic range of even 1000:1 and printed photographs are at most 100:1. Yet we know that colour perception depends on the overall dynamic range of the scene. The new HDR displays can output contrast ratios of 100000:1 and we will use them to measure constancy in lab conditions but with real world brightnesses. A third challenge that we face in making colour photographs match our perception of the real world is the inaccuracy of colour memory. Typically, when we view a photograph, we do not have the real thing to compare it with, but must recall the original scene from memory. The imperfections of our memory then may taint our judgment. It is well known that our memory colours for familiar objects such as sky, grass, and skin tend to be 'over-saturated' -- grass may be remembered as greener and the sky as bluer than they actually are. Thus, when we test colour correction algorithms by asking people which image they prefer, we might find that they do not prefer the one that most accurately reproduces the original scene, but instead matches their imperfect memory. We will quantify these effects of memory and preference. Finally, our research will, at all stages, consider how measured percepts of colour might be predicted by mathematical models. Ultimately, we will design algorithms to automatically see colours as we do, making for better photographs and more useful vision machines.