CAREER: Sensing the World with the Distributed Camera

我们生活在一个图像无处不在的世界里，我们指尖上的图像数量似乎在以指数级的速度增长。 这些图像来自各种各样的来源，包括互联网地图网站、网络摄像头、监视和侦察摄像头，以及世界各地数百万摄影师向照片共享网站上传数十亿张图像。 综合起来，这些照片来源可以被认为是一个分布式相机，以前所未有的规模捕捉整个世界，并不断记录其城市，山脉，建筑物，人物和事件。这项研究正在创建基本的计算工具，用于“校准”这个分布式相机，通过使用计算机视觉技术从互联网照片集合中构建的3D模型的全球数据库。 重点是创建更快，更强大的算法，用于从非结构化照片集进行3D重建，以及用于世界规模姿态估计的技术-仅从图像数据精确计算照片在世界上的位置。 这些工具正在产生大型的、全球范围的校准图像数据库，这些数据库可以帮助回答科学中的问题（例如，找到中央公园的所有可用照片以便跟踪不同植物的开花时间）和工程（例如，找到所有曾经拍摄过的特定桥梁的照片，以帮助找出它倒塌的原因），并对其他领域产生影响，包括安全、消费者摄影和多媒体搜索。 这项研究与教育和推广紧密结合，包括为高中生举办暑期研讨会，让他们接触3D视觉技术的计划。

We live in a world of ubiquitous imagery, where the number of images at our fingertips is growing at a seemingly exponential rate. These images come from a wide variety of sources, including Internet mapping sites, webcams, surveillance and reconnaissance cameras, and millions of photographers around the world uploading billions and billions of images to photo-sharing websites. Taken together, these sources of photos can be thought of as constituting a distributed camera capturing the entire world at unprecedented scale, and continually documenting its cities, mountains, buildings, people, and events.This research is creating the basic computational tools for "calibrating" this distributed camera, through use of a world-wide database of 3D models built from Internet photo collections using computer vision techniques. The focus is on creating faster, more robust algorithms for 3D reconstruction from unstructured photo collections, as well as techniques for world-scale pose estimation--computing precisely where in the world a photo was taken from image data alone. These tools are yielding large, world-wide databases of calibrated imagery that can help answer questions in science (e.g., finding all available photos of Central Park so as to track flowering times of different plants) and engineering (e.g., finding all of the photos ever taken of a particular bridge to help figure out why it collapsed), and have impact other areas including security, consumer photography, and multimedia search. This research is closely integrated with education and outreach, and includes plans for a summer workshop for high-school students to engage with 3D vision technologies.