Dynamic Non-Regular Sampling Sensor Using Frequency Selective Reconstruction
Dynamic Non-Regular Sampling Sensor Using Frequency Selective Reconstruction
复制标题
DOI：
10.1109/tcsvt.2018.2876653
复制
发表时间：
2019-10
影响因子：
8.4
通讯作者：
Markus Jonscher;Jürgen Seiler;Daniela Lanz;M. Schöberl;M. Bätz;André Kaup
中科院分区：
文献类型：
--
作者：
Markus Jonscher;Jürgen Seiler;Daniela Lanz;M. Schöberl;M. Bätz;André Kaup
图像和视频的高空间和高时间分辨率在许多应用中都是理想的，例如娱乐系统、监控制造过程或视频监控。然而，由于每秒像素吞吐量的限制，在以低时间分辨率获取高空间分辨率的序列或相反的情况下，总是存在权衡。本文提出了一种改进的传感器概念，既能获得高空间分辨率，又能获得高时间分辨率。这是通过动态读出非规则顺序的像素子集以获得高时间分辨率来实现的。然后，通过执行部分获取的帧的后续3D重建来获得完全高的空间分辨率。所提出的动态读出的主要好处是，对于每一帧，不同的采样点是可用的，这是有利的，因为该信息可以显著地提高所提出的重建算法的重建质量。与静态读出策略相比，动态读出策略的峰值信噪比(PSNR)最高可达8.55d B。与其他最先进的技术，如帧速率上转换或超分辨率，也能够重建具有高空间和高时间分辨率的序列相比，PSNR的平均增益高达6.58dB是可能的。
Both a high spatial and a high temporal resolution of images and videos are desirable in many applications, such as entertainment systems, monitoring manufacturing processes, or video surveillance. Due to the limited throughput of pixels per second, however, there is always a tradeoff between acquiring sequences with a high spatial resolution at a low temporal resolution or vice versa. In this paper, a modified sensor concept is proposed which is able to acquire both a high spatial and a high temporal resolution. This is achieved by dynamically reading out only a subset of pixels in a non-regular order to obtain a high temporal resolution. A full high spatial resolution is then obtained by performing a subsequent 3D reconstruction of the partially acquired frames. The main benefit of the proposed dynamic readout is that for each frame, different sampling points are available, which is advantageous since this information can significantly enhance the reconstruction quality of the proposed reconstruction algorithm. Using the proposed dynamic readout strategy, gains in the peak-signal-to-noise ratio (PSNR) of up to 8.55 dB are achieved compared with a static readout strategy. Compared with the other state-of-the-art techniques, such as frame rate up-conversion or super-resolution, which are also able to reconstruct sequences with both a high spatial and a high temporal resolution, average gains in PSNR of up to 6.58 dB are possible.