3D Computer Vision for NPR from images and video

想象一下，一台可以拍摄看起来像画的照片的相机。一些现代摄像机已经实现了这一点--我就有这样一台摄像机。它内置的软件可以对照片进行描摹，从而产生绘画效果，看起来像油画、水彩画，或者商业系统可用的任何一种媒体。但现在，想象一下，不只是描摹，想象一台相机可以旋转物体，从新的视角绘制它们，甚至从不同的视角渲染同一物体的不同部分。这款相机可以通过在物体上画出与曲线对齐的标记来增强物体的三维特性，甚至可以通过将物体变得更大来增强突出特征。更重要的是，这款相机不仅适用于静止图像，也适用于运动图像，实现卡通效果--真正燃烧道路的卡通汽车！这款3D绘画相机可以让你拍下你自己的老大师，比如范·艾克，他故意打破透视规则，让人们注意到他的照片中发生了什么。像马蒂斯这样的新大师喜欢在画东西的时候倾斜和扭曲它们；而像霍克尼这样的新大师最近通过合成从不同角度拍摄的照片养成了绘画的习惯。它将允许您真正呈现出对象的形状，像杜勒曾经做的那样对其进行着色。它将允许你创造你自己的卡通，完整的条纹，挤压和拉伸效果和灰尘云，所有这些都是三维的，这是第一次。我们的研究是关于建造这样一台相机。

Imagine a camera that could take photographs that looked like paintings. Some modern video cameras already allow this - I have such a camera. The software built into it traces over photographs to yield painterly effects that look like an oil painting, or a watercolour, or any of the many media available to commerical systems.But now, instead of just tracing, imagine a camera that is able to rotate objects so they are painted from new points of view, and even render different parts of the same object from different points of view. This camera can enhance the three-dimensional nature of objects by making marks that line-up with curves on it, and can even enhance prominent features by making them bigger still. And more, this camera works not just on still images but on moving images too, enabling cartoon-like effects - cartoon cars that really burn the road!This 3D-painting camera would allow you to snap your own old Masters, such as Van Eyck, who deliberately broke the rules of perspective to draw attention to what was going on in his pictures. Newer Masters like Matisse who liked to tilt and twist the objects as he painted them; and yet newer Masters like Hockney who has made a recent habit of painting by compositing photographs taken from different views. It would allow you to really bring out the shape of an object, shading it the way Durer once did. And it would allow you to create your own cartoons, complete with streak-lines, squash-and-stretch effects and dust-clouds, all in three-dimensions for the first time.Our research is about building such a camera.