Physics-based colour models in computer vision, colour science, graphics and multimedia

在我的研究中，我结合了基于光和表面之间相互作用的物理的详细模型来(a)理解图像和视频，从而理解创建它们的底层光和表面；(b)使用这些相同的效果，反过来在图形中创建逼真的场景。我已经开发了一种方法来生成（计算机图形学）和理解（计算机视觉）图像使用{\ \它的整个光谱}，而不仅仅是普通图像的通常的红，绿，蓝。在一天结束的时候，实际上我们的视觉设备使用R， G和B，但在路上，光是作为一个完整的光谱传输的，包括一些红色，绿色等，以及两者之间的每一种颜色。到目前为止，我已经创建了一个医学成像应用程序，用于查看内部体积，将磁磁共振成像数据转换为计算机图形。由于整个光谱现在是可用的，一些器官，骨骼，皮肤等可以采取统一的颜色（或没有颜色），而其他器官突出显示，这可以实时发生，而我们使用滑块。我建议使用这种方法来处理困难的基于物理的图像，如昆虫彩虹色、钻石切面等的美丽效果。在计算机视觉中，我一直在研究从图像中去除阴影的方法。这对于让机器人抓住一个物体而不试图抓住它的影子、在安全情况下跟踪人等任务非常有用。但它也可以简单地用作图像的补色工具，比如在数码照片中去除面部的阴影。阴影本身是有用的，不仅仅是为了消除：它们提供了关于形状和照明的深刻线索。我在这个提案中提出了一些方法，通过改变阴影来帮助解决如何“重新照亮”图像的难题。

In my research, I incorporate detailed models based on the physics of interaction between light and surfaces to (a) understand images and video and hence the underlying lights and surfaces that created them; and (b) use these same effects in reverse to create realistic scenes in graphics.  I have developed a method  for generating (Computer Graphics) and understanding (Computer Vision) images using {\it whole spectra}, rather than just the usual Red, Green, and Blue of ordinary images. At the end of the day, in fact our visual equipment uses R, G, and B, but on the way, light is transmitted as a whole spectrum, including some red, green, etc., as well as every colour in between. So far, I have created a medical imaging application, for seeing inside volumes, that transforms magnetic MRI data into computer graphics. Since whole spectra are now available, some of the organs, bone, skin etc. can take on a unified colour (or no colour) while other organs are highlighted, and this can happen in real-time, while we use a slider.  I propose using the method to tackle difficult physics-based imagery such as the beautiful effects involved in insect iridescence, diamond facets, and the like.In Computer Vision, I have been looking at ways to {\it remove shadows} from images. This is very useful for such tasks as having a robot grasp an object without trying to grasp its shadow, trackingpeople in a security situation, etc. But it can also be used as simply a touch-up tool for images -- removing dark shadows on a face in a digital photo, say.  Shadows are useful in themselves, not just to be removed: they provide a profound cue about shape and lighting. I set out approaches in this proposal that help in the difficult issue of how to "re-light" images, by changing the shadows.