Physics-based colour models in computer vision, colour science, graphics and multimedia

在我的研究中，我结合了基于光和表面之间相互作用的物理的详细模型，以(A)理解图像和视频，从而理解创造它们的底层光和表面；以及(B)反过来使用这些相同的效果来在图形中创建逼真的场景。我已经开发了一种方法，用于使用{\it整个光谱}来生成(计算机图形)和理解(计算机视觉)图像，而不仅仅是普通图像的通常的红、绿、蓝。实际上，在一天结束时，我们的视觉设备使用R、G和B，但在此过程中，光作为整个光谱传输，包括一些红色、绿色等，以及介于两者之间的每一种颜色。到目前为止，我已经创建了一个医学成像应用程序，用于查看内部体积，将磁性MRI数据转换为计算机图形。由于现在可以使用全光谱，一些器官、骨骼、皮肤等可以呈现统一的颜色(或不加颜色)，而其他器官则突出显示，这可以在我们使用滑块的情况下实时发生。我建议使用这种方法来处理基于物理的困难图像，如昆虫虹彩、钻石小面等涉及的美丽效果。在计算机视觉中，我一直在寻找从图像中去除阴影的方法。这对于让机器人在不试图抓住物体的阴影的情况下抓住物体、在安全情况下跟踪人等任务非常有用。但它也可以被用作图像的简单润色工具--比如说，消除数码照片中面部的黑色阴影。阴影本身很有用，不仅仅是消除：它们提供了关于形状和光线的深刻提示。我在这个提案中列出了一些方法，帮助解决如何通过改变阴影来“重新照亮”图像这一难题。

In my research, I incorporate detailed models based on the physics of interaction between light and surfaces to (a) understand images and video and hence the underlying lights and surfaces that created them; and (b) use these same effects in reverse to create realistic scenes in graphics.  I have developed a method  for generating (Computer Graphics) and understanding (Computer Vision) images using {\it whole spectra}, rather than just the usual Red, Green, and Blue of ordinary images. At the end of the day, in fact our visual equipment uses R, G, and B, but on the way, light is transmitted as a whole spectrum, including some red, green, etc., as well as every colour in between. So far, I have created a medical imaging application, for seeing inside volumes, that transforms magnetic MRI data into computer graphics. Since whole spectra are now available, some of the organs, bone, skin etc. can take on a unified colour (or no colour) while other organs are highlighted, and this can happen in real-time, while we use a slider.  I propose using the method to tackle difficult physics-based imagery such as the beautiful effects involved in insect iridescence, diamond facets, and the like.In Computer Vision, I have been looking at ways to {\it remove shadows} from images. This is very useful for such tasks as having a robot grasp an object without trying to grasp its shadow, trackingpeople in a security situation, etc. But it can also be used as simply a touch-up tool for images -- removing dark shadows on a face in a digital photo, say.  Shadows are useful in themselves, not just to be removed: they provide a profound cue about shape and lighting. I set out approaches in this proposal that help in the difficult issue of how to "re-light" images, by changing the shadows.