Sensing Beyond Barriers: Theory, Algorithms and Applications

超越障碍的感知：理论、算法和应用

• 批准号: MR/S034897/1
• 负责人: Ayush Bhandari
• 金额: $ 149.43万
• 依托单位: Imperial College London
• 依托单位国家: 英国
• 项目类别: Fellowship
• 财政年份: 2020
• 资助国家: 英国
• 起止时间: 2020 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=MR%2FS034897%2F1
• 关键词: Sensing; Beyond; Barriers; Theory; Algorithms

Data capture via imaging and sensing has become a common aspect of our existence and helps extend human vision and perception. Whether it is a microscope used for cell counting or the latest version of autonomous vehicle which aims to see through the fog; the sensing apparatus is expensive and limited in functionality. For example, the cameras of a self-driving car may white out due to exposure to excessive light when coming out of a tunnel.In many of applications, hardware (that captures data) and algorithms (which recover meaningful information from data) are treated decoupled entities; first capture data, extract information later. Hence, there is a limit to what can be recovered from the data based on the limitations of the hardware. Can we go beyond such limitations?The purpose of this research is to achieve a synergistic balance between hardware and algorithms by means of a co-design, so that popularly held limits in data capture and imaging can be broken, thus making the invisible, visible.Questions that we seek to answer include: Can we do bio-imaging with low-cost sensors (e.g. Microsoft Kinect)? Can we capture information beyond the usual dynamic range? Can we non-invasively classify blood cells by inferring cell geometry? Can we remove reflections in photographs? Can we see through diffusive media? These questions require us to go beyond the conventional barriers (e.g. dynamic range, spatio-temporal resolution, how fast the data is captured etc).The work in this proposal relies a co-design approach where carefully optimized capture process yields computationally encoded measurements from which the information is decoded using recovery algorithms. This approach is used to modify hardware and develop new algorithms to recover information. Application areas span from bio-imaging (cell-classification, fluorescence lifetime imaging, terahertz spectroscopy), consumer imaging (autonomous vehicles) to conceptualization of new sensing hardware. Three specific barriers are considered: (1) Dynamic Range Barrier. We propose the use of recording measurements that are non-linearly mapped by modulo operations. This is a fundamentally new way of sensing or digitising information and is largely unexplored. Our initial work shows that a simple correction to the Nyquist rate linked with Shannon's sampling theory allows for recovery of a bandlimited signal from modulo information. Remarkably, the sampling bound is independent of the the threshold. In this proposal we study a larger class of signals including sum-of-sinusoids, sparse signals and smooth signal and their link with application areas such as direction-of-arrival estimation and beamforming.(2) Resolution Barrier. Recovering spikes from low-pass filtered measurements is a classical problem and is known as super-resolution. However, in many practical cases of interest, the pulse or filter may be distorted due to physical properties of propagation and transmission. Such cases can not be handled well by existing signal models. Inspired by problems in spectroscopy, ground penetrating radar, photoacoustic imaging and ultra-wide band arrays, on which we base our experiments, in this work we take a step towards recovering spikes from time-varying pulses and prepare algorithms for non-ideal super-resolution. Furthermore, when the pulse or filter is smooth and not necessarily bandlimited, optimial bandwith selction for sparse-deconvolution is an open problem that is addressed in this work. (3) Bandwidth Barrier. We define the notion of bandwidth in context of Special Affine Fourier transforms which generalises a number of well known transformations. This allows us to prepare a unifying approach for studying sampling theory which is applicable to a wider class of signal models. Our algorithms are validated on experimentally acquired data with the help of inter-disciplinary and multi-university collaborations

通过成像和传感捕获数据已成为我们生活中的一个常见方面，有助于扩展人类的视觉和感知。无论是用于细胞计数的显微镜，还是最新版本的旨在穿透雾的自动驾驶汽车，传感设备都是昂贵的，功能有限。例如，自动驾驶汽车的摄像头可能会因为在隧道中暴露于过多的光线而变成白色。在许多应用中，硬件（捕获数据）和算法（从数据中恢复有意义的信息）被视为解耦实体;首先捕获数据，然后提取信息。因此，基于硬件的限制，可以从数据中恢复的内容是有限的。我们能超越这些限制吗？本研究的目的是通过协同设计实现硬件和算法之间的协同平衡，从而打破数据采集和成像中普遍存在的限制，从而使不可见变得可见。我们寻求回答的问题包括：我们能否用低成本传感器（例如Microsoft Kinect）进行生物成像？我们能否捕获超出通常动态范围的信息？我们可以通过推断细胞几何形状来非侵入性地对血细胞进行分类吗？我们可以消除照片中的反射吗？我们能透过扩散介质看到吗？这些问题要求我们超越传统的障碍（例如动态范围，时空分辨率，如何快速捕获数据等）。这项提案中的工作依赖于一种协同设计方法，其中精心优化的捕获过程产生计算编码的测量结果，使用恢复算法解码信息。这种方法用于修改硬件和开发新的算法来恢复信息。应用领域从生物成像（细胞分类、荧光寿命成像、太赫兹光谱）、消费成像（自动驾驶汽车）到新传感硬件的概念化。考虑了三个具体的障碍：（1）动态范围障碍。我们建议使用的记录测量，非线性映射模运算。这是一种全新的感知或数字化信息的方式，而且在很大程度上尚未开发。我们的初步工作表明，一个简单的校正与香农的采样理论相关联的奈奎斯特速率允许从模信息的带限信号的恢复。值得注意的是，采样界与阈值无关。在这个建议中，我们研究了一个更大的类的信号，包括正弦曲线，稀疏信号和平滑信号和它们的链接与应用领域，如到达方向估计和波束形成。(2)分辨率屏障。从低通滤波测量中恢复尖峰是一个经典问题，被称为超分辨率。然而，在许多感兴趣的实际情况下，脉冲或滤波器可能由于传播和传输的物理特性而失真。现有的信号模型不能很好地处理这种情况。受光谱学，探地雷达，光声成像和超宽带阵列中的问题的启发，我们基于我们的实验，在这项工作中，我们朝着从时变脉冲中恢复尖峰迈出了一步，并准备了非理想超分辨率的算法。此外，当脉冲或滤波器是平滑的，不一定带限，最佳带宽选择稀疏反卷积是一个开放的问题，在这项工作中解决。(3)带宽障碍。我们定义的特殊仿射傅立叶变换的背景下，概括了一些众所周知的变换的带宽的概念。这使我们能够准备一个统一的方法来研究采样理论，适用于更广泛的一类信号模型。在跨学科和多大学合作的帮助下，我们的算法在实验获得的数据上进行了验证

项目成果

Unlimited Sampling From Theory to Practice: Fourier-Prony Recovery and Prototype ADC

• DOI: 10.1109/tsp.2021.3113497
• 发表时间: 2021-05
• 期刊: IEEE Transactions on Signal Processing
• 影响因子: 5.4
• 作者: Ayush Bhandari;F. Krahmer;T. Poskitt

One-Bit Sampling in Fractional Fourier Domain

分数傅里叶域中的一位采样

• DOI: 10.1109/icassp40776.2020.9053505
• 发表时间: 2020
• 作者: Bhandari A

On Unlimited Sampling and Reconstruction

• DOI: 10.1109/tsp.2020.3041955
• 发表时间: 2019-05
• 期刊: IEEE Transactions on Signal Processing
• 影响因子: 5.4
• 作者: Ayush Bhandari;F. Krahmer;R. Raskar

Unlimited Sampling with Sparse Outliers: Experiments with Impulsive and Jump or Reset Noise

具有稀疏异常值的无限采样：脉冲和跳跃或重置噪声的实验

• DOI: 10.1109/icassp43922.2022.9746982
• 发表时间: 2022
• 作者: Bhandari A

MR. TOMP : Inversion of the Modulo Radon Transform (MRT) via Orthogonal Matching Pursuit (OMP)

• DOI: 10.1109/icip46576.2022.9897428
• 发表时间: 2022-10
• 期刊: 2022 IEEE International Conference on Image Processing (ICIP)
• 作者: Matthias Beckmann;Ayush Bhandari