A Real-Time Multiaperture Omnidirectional Visual Sensor Based on an Interconnected Network of Smart Cameras
A Real-Time Multiaperture Omnidirectional Visual Sensor Based on an Interconnected Network of Smart Cameras
复制标题
基于智能相机互联网络的实时多孔径全向视觉传感器
DOI：
10.1109/tcsvt.2014.2355713
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
Y. Leblebici
中科院分区：
文献类型：
--
作者：
Kerem Seyid;Vladan Popovic;Omer Cogal;Abdulkadir Akin;Hossein Afshari;A. Schmid;Y. Leblebici
Panoptic全向多孔径视觉系统的集中式和多级实现先前由我们提出，依赖于将所有摄像机输出传输到单个中央处理节点以进行全向图像和视频重建。提出了一种新的全景视觉系统全方位视觉重建算法的分布式并行实现方法。并行方法旨在克服集中式方法的可扩展性问题和存储器带宽限制。实时硬件实现与图像处理，存储器和互连功能的相机模块。介绍了一种用于将具有互连特征的相机模块布置成目标互连网络拓扑的方法。介绍了一种独特的定制多现场可编程门阵列硬件平台，用于实现49台摄像机的互连网络原型Panoptic系统。提出了一种硬件架构的基础上提出的硬件平台，使实时实施的混合算法，沿着的成像结果和资源利用率。在上述原型上实现的全视应用程序的实时实现结果进行了演示。
Centralized and multilevel implementations of the Panoptic omnidirectional multiaperture visual system were previously presented by us, relying on the transmission of all camera outputs to a single central processing node for omnidirectional image and video reconstruction. In this paper, a novel distributed and parallel implementation of the omnidirectional vision reconstruction algorithm of the Panoptic system is presented. The parallel approach aims to overcome the scalability problems and memory bandwidth limitations of the centralized approach. The real-time hardware implementation is presented for camera modules with image processing, memory, and interconnectivity features. A methodology is introduced for the arrangement of camera modules with interconnectivity feature into a target interconnection network topology. A unique custom-made multiple-field-programmable gate array hardware platform is introduced for the implementation of an interconnected network of 49 camera prototype Panoptic system. A hardware architecture based on presented hardware platform enabling the real-time implementation of the blending algorithms is presented, along with the imaging results and resource utilization. The real-time implementation results of the implemented omnivision application on the mentioned prototype are demonstrated.