1-Bit 3-Dimensional Imaging
1 位 3 维成像
基本信息
- 批准号:514479946
- 负责人:
- 金额:--
- 依托单位:
- 依托单位国家:德国
- 项目类别:Research Grants
- 财政年份:
- 资助国家:德国
- 起止时间:
- 项目状态:未结题
- 来源:
- 关键词:
项目摘要
Time-of-Flight (ToF) cameras are 3D imaging systems able to capture the geometry of a scene. Typically, little attention is paid to the quantization scheme and uniform quantization of the measurements with enough number of bits is assumed. In this project we aim to follow up on recent results showing that reliable multiple-path 3D imaging can be obtained from one-bit-quantized data. The first one-bit ToF pixel will be designed, fabricated and evaluated. The ability to obtain reliable 3D images from one-bit data enables a massive reduction of the data to be captured and transmitted by the camera. This reduces the hardware requirements upstream in terms of memory and bandwidth. Furthermore, one-bit ToF imaging deals with a new form of inverse problem, in which the measurements have undergone a non-linear transformation. The reduction of the data flow per pixel also allows for larger ToF pixel arrays, paving the way for Megapixel Tof imaging. The binary nature of the measurements also avoids the need for ADC banks, freeing chip space and further helping on this front. Despite to date all existing ToF cameras rely on uniform quantization, preliminary work of Dr. Heredia Conde has demonstrated the feasibility of the proposed concept by means of realistic simulations. These first results suggest that such a one-bit ToF pixel would exhibit superior performance to alternative sensing schemes relying on different tradeoffs between number of measurements and bit depth for the same bit budget. In this project we will design and construct the first one-bit ToF camera. This hardware novelty will be coupled to an algorithmic counterpart, able to estimate the geometry of the observed scene from the measurements. The result will be an unprecedented time-resolved computational imaging system, in which the information is first encoded into lightweight streams of one-bit data and then decoded into one or several depth images. The necessary tasks for the development of a functional one-bit 3D imaging system can be summarized as follows. First, the architecture of the one-bit pixel will be designed and simulated. Then a single pixel or a small array will be fabricated for testing. The fabricated device will be tested for operability. Building upon the insights gained from this first device, a complete array of ToF pixels will be fabricated and integrated with a modulated NIR illumination system and control circuitry and the system will be tested. The necessary algorithms for reconstructing the 3D geometry of the scene from the obtained one-bit data will be developed. This includes the disentanglement of multiple return paths per pixel. Finally, the overall performance of the system as 3D imaging sensor is to be systematically evaluated and compared to the state of the art and to the results obtained from simulations.
飞行时间(ToF)相机是能够捕获场景几何形状的3D成像系统。通常,很少关注量化方案,并且假设具有足够数量的比特的测量的均匀量化。在这个项目中,我们的目标是跟进最近的结果表明,可靠的多路径三维成像可以从一位量化的数据。第一个一位ToF像素将被设计,制造和评估。从一位数据获得可靠的3D图像的能力能够大幅减少相机捕获和传输的数据。这降低了上游在内存和带宽方面的硬件要求。此外,一位ToF成像处理一种新形式的逆问题,其中测量值经历了非线性变换。每像素数据流的减少还允许更大的ToF像素阵列,为百万像素Tof成像铺平了道路。测量的二进制特性还避免了对ADC组的需求,从而释放了芯片空间,并在这方面提供了进一步的帮助。尽管到目前为止,所有现有的ToF相机都依赖于均匀量化,但Heredia孔德博士的初步工作已经通过逼真的模拟证明了所提出的概念的可行性。这些第一结果表明,这样的一比特ToF像素将表现出上级替代感测方案的性能,该替代感测方案依赖于针对相同比特预算的测量数量和比特深度之间的不同权衡。在这个项目中,我们将设计和构建第一个一位ToF相机。这种新奇将被耦合到一个算法对应,能够估计的几何形状的观察到的场景从测量。其结果将是一个前所未有的时间分辨计算成像系统,其中信息首先被编码成一位数据的轻量级流,然后解码成一个或多个深度图像。开发功能性一位3D成像系统的必要任务可以总结如下。首先,设计并模拟一位元像素的架构。然后将制造单个像素或小阵列用于测试。将对制造的器械进行可操作性测试。在从第一台设备中获得的见解的基础上,将制造完整的ToF像素阵列并与调制近红外照明系统和控制电路集成,并对系统进行测试。将开发用于从所获得的一位数据重建场景的3D几何形状的必要算法。这包括每个像素的多个返回路径的解纠缠。最后,作为3D成像传感器的系统的整体性能将被系统地评估,并与现有技术和从模拟中获得的结果进行比较。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Professor Dr. Bhaskar Choubey其他文献
Professor Dr. Bhaskar Choubey的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Professor Dr. Bhaskar Choubey', 18)}}的其他基金
L2S for CMOS Image Sensor Design and Bridging the Gap
用于 CMOS 图像传感器设计并缩小差距的 L2S
- 批准号:
498557035 - 财政年份:
- 资助金额:
-- - 项目类别:
Research Units
相似国自然基金
Scalable Learning and Optimization: High-dimensional Models and Online Decision-Making Strategies for Big Data Analysis
- 批准号:
- 批准年份:2024
- 资助金额:万元
- 项目类别:合作创新研究团队
相似海外基金
Three dimensional material flow visualization in dissimilar friction stir welding by X-ray transmission imaging
通过 X 射线透射成像实现异种材料搅拌摩擦焊中的三维材料流动可视化
- 批准号:
24K17532 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Grant-in-Aid for Early-Career Scientists
QuSeC-TAQS: Nanodiamond Quantum Sensing for Four-Dimensional Live-Cell Imaging
QuSeC-TAQS:用于四维活细胞成像的纳米金刚石量子传感
- 批准号:
2326628 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Continuing Grant
Three-dimensional Nonlinear Structured Illumination for Live Imaging with 80 nm resolution
用于 80 nm 分辨率实时成像的三维非线性结构照明
- 批准号:
10637540 - 财政年份:2023
- 资助金额:
-- - 项目类别:
High-dimensional mass imaging of muscle for the mechanistic study of T cells in inclusion body myositis
肌肉高维质量成像用于 T 细胞在包涵体肌炎机制研究中的应用
- 批准号:
10669370 - 财政年份:2023
- 资助金额:
-- - 项目类别:
High dimensional in situ proteomics imaging system
高维原位蛋白质组成像系统
- 批准号:
522213027 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Major Research Instrumentation
Collaborative Research: Active and Passive Seismic Imaging of the Three-Dimensional Structure and Magma System beneath the Summit of Kilauea Volcano
合作研究:基拉韦厄火山顶下三维结构和岩浆系统的主动和被动地震成像
- 批准号:
2218645 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Standard Grant
3-dimensional prompt gamma imaging for online proton beam dose verification
用于在线质子束剂量验证的 3 维瞬发伽马成像
- 批准号:
10635210 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Three-dimensional ultrastructural analysis of heterogeneous intercellular connections using correlative volume-imaging
使用相关体积成像对异质细胞间连接进行三维超微结构分析
- 批准号:
23K09132 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Grant-in-Aid for Scientific Research (C)
Three-dimensional fluorescence imaging flow cytometry at up to million frames per second
每秒高达百万帧的三维荧光成像流式细胞术
- 批准号:
10568627 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Collaborative Research: Active and Passive Seismic Imaging of the Three-Dimensional Structure and Magma System beneath the Summit of Kilauea Volcano
合作研究:基拉韦厄火山顶下三维结构和岩浆系统的主动和被动地震成像
- 批准号:
2218646 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Standard Grant