High-speed videography using a dense camera array
High-speed videography using a dense camera array
复制标题
DOI：
10.1109/cvpr.2004.124
复制
发表时间：
2004-06
期刊：
影响因子：
--
通讯作者：
Bennett Wilburn;Neel Joshi;V. Vaish;M. Levoy;M. Horowitz
中科院分区：
文献类型：
--
作者：
Bennett Wilburn;Neel Joshi;V. Vaish;M. Levoy;M. Horowitz
我们展示了一个系统，用于捕获数千帧每秒（fps）的视频使用密集阵列的廉价30 fps的CMOS图像传感器。使用相机阵列捕捉高速视频的一个好处是，我们可以通过简单地添加更多相机来扩展到更高的速度。即使在极高的帧速率下，我们的阵列架构也支持从所有摄像机向磁盘连续流式传输。这使我们能够记录不可预测的事件，在这些事件中，在感兴趣的事件之前没有发生任何可以用来触发记录开始的事件。使用来自相机阵列的图像合成一个高速视频序列需要校准和校正这些相机的变化的辐射和几何特性的方法。我们假设我们的场景是相对平面的，或者离相机很远，因此可以使用投影变换来对齐图像。我们分析了这种假设的错误，并提出了使它们在视觉上不那么令人反感的方法。我们还提出了一种新的方法来自动颜色匹配我们的传感器。最后，我们演示了如何补偿由电子卷帘快门引起的空间和时间失真，这是低端CMOS传感器的一个常见特征。
We demonstrate a system for capturing multi-thousand frame-per-second (fps) video using a dense array of cheap 30 fps CMOS image sensors. A benefit of using a camera array to capture high-speed video is that we can scale to higher speeds by simply adding more cameras. Even at extremely high frame rates, our array architecture supports continuous streaming to disk from all of the cameras. This allows us to record unpredictable events, in which nothing occurs before the event of interest that could be used to trigger the beginning of recording. Synthesizing one high-speed video sequence using images from an array of cameras requires methods to calibrate and correct those cameras' varying radiometric and geometric properties. We assume that our scene is either relatively planar or is very far away from the camera and that the images can therefore be aligned using projective transforms. We analyze the errors from this assumption and present methods to make them less visually objectionable. We also present a new method to automatically color match our sensors. Finally, we demonstrate how to compensate for spatial and temporal distortions caused by the electronic rolling shutter, a common feature of low-end CMOS sensors.