Computational Transient Imaging: Instrumentation, Image Formation Models, Inverse Methods, and Applications

计算瞬态成像:仪器、图像形成模型、反演方法和应用

基本信息

项目摘要

The relatively young research direction of transient imaging deals with the time-resolved capture of non-stationary light distribution on macroscopic scales, or "videos of light in flight". Transient images are expected to enable a deeper understanding of, and elegant solutions to, many problems in computer vision, just as impulse responses have proven a versatile and valuable tool in the sciences and engineering. To date, the acquisition of transient images required very expensive and highly sensitive optical devices (ultrashort pulse lasers and streak cameras) and thus was reserved to a few highly specialized laboratories. The proposed project is based on our own development of a reconstruction technique of transient images from opto-electronical correlation measurements that are readily available from lock-in image sensors found in time-of-flight range cameras. The goal of our work is to better understand this alternative hardware platform for transient imaging, and to find answers to the following central questions:How can transient images be measured at a higher resolution, in shorter time and at reduced hardware cost? How can existing models and numerical methods make better use of the data sparsity inherent to transient signals, in order to obtain more reliable reconstructions? How can multi-path image formation models be inverted to solve long-standing computer vision problems? Which new application opportunities emerge astransient imaging becomes widely available?With this project, we will address all of these questions in an interdisciplinary way, with computation as the key enabler.
瞬态成像是一个相对年轻的研究方向,主要研究在宏观尺度上对非平稳光分布的时间分辨捕获,或称“飞行中的光视频”。瞬态图像有望使计算机视觉中的许多问题得到更深入的理解和优雅的解决方案,就像脉冲响应在科学和工程中被证明是一种多功能和有价值的工具一样。到目前为止,获取瞬态图像需要非常昂贵和高度敏感的光学设备(超短脉冲激光器和条纹相机),因此保留给少数高度专业化的实验室。拟议的项目是基于我们自己开发的光电相关测量的瞬态图像的重建技术,这些测量可以很容易地从飞行时间测距相机中发现的锁定图像传感器中获得。我们的工作的目标是更好地了解这种替代硬件平台的瞬态成像,并找到以下核心问题的答案:如何可以瞬态图像测量在更高的分辨率,在更短的时间和降低硬件成本?现有的模型和数值方法如何更好地利用瞬态信号固有的数据稀疏性,以获得更可靠的重建?如何反转多路径图像形成模型来解决长期存在的计算机视觉问题?哪些新的应用机会出现天文成像变得广泛可用?通过这个项目,我们将以跨学科的方式解决所有这些问题,并将计算作为关键推动因素。

项目成果

期刊论文数量(6)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
4D imaging through spray-on optics
通过喷涂光学器件进行 4D 成像
  • DOI:
    10.1145/3072959.3073589
  • 发表时间:
    2017
  • 期刊:
  • 影响因子:
    0
  • 作者:
    J. Iseringhausen;B. Goldlücke;N. Pesheva;S. Iliev;A. Wender;M. Fuchs;M. B. Hullin
  • 通讯作者:
    M. B. Hullin
Snapshot difference imaging using correlation time-of-flight sensors
使用相关飞行时间传感器进行快照差异成像
  • DOI:
    10.1145/3130800.3130885
  • 发表时间:
    2017
  • 期刊:
  • 影响因子:
    0
  • 作者:
    C. Callenberg;F. Heide;G. Wetzstein;M. B. Hullin
  • 通讯作者:
    M. B. Hullin
Solving Trigonometric Moment Problems for Fast Transient Imaging
  • DOI:
    10.1145/2816795.2818103
  • 发表时间:
    2015-11-01
  • 期刊:
  • 影响因子:
    6.2
  • 作者:
    Peters, Christoph;Klein, Jonathan;Klein, Reinhard
  • 通讯作者:
    Klein, Reinhard
Trigonometric Moments for Editable Structured Light Range Finding
用于可编辑结构光测距的三角矩
  • DOI:
    10.2312/vmv.20191315
  • 发表时间:
    2019
  • 期刊:
  • 影响因子:
    0
  • 作者:
    S. Werner;J. Iseringhausen;C. Callenberg;M. B. Hullin
  • 通讯作者:
    M. B. Hullin
Non-line-of-sight Reconstruction Using Efficient Transient Rendering
  • DOI:
    10.1145/3368314
  • 发表时间:
    2020-02-01
  • 期刊:
  • 影响因子:
    6.2
  • 作者:
    Iseringhausen, Julian;Hullin, Matthias B.
  • 通讯作者:
    Hullin, Matthias B.
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Professor Dr.-Ing. Matthias Hullin其他文献

Professor Dr.-Ing. Matthias Hullin的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

相似国自然基金

Transient Receptor Potential 通道 A1在膀胱过度活动症发病机制中的作用
  • 批准号:
    30801141
  • 批准年份:
    2008
  • 资助金额:
    28.0 万元
  • 项目类别:
    青年科学基金项目

相似海外基金

High Resolution Imaging Using Transient Binders
使用瞬态粘合剂进行高分辨率成像
  • 批准号:
    EP/W034735/1
  • 财政年份:
    2023
  • 资助金额:
    --
  • 项目类别:
    Fellowship
Fast Transient Study with Deep-Imaging Surveys and Synergistic Observations
通过深度成像调查和协同观测进行快速瞬态研究
  • 批准号:
    22K14069
  • 财政年份:
    2022
  • 资助金额:
    --
  • 项目类别:
    Grant-in-Aid for Early-Career Scientists
Imaging and modelling transient patterns of human brain activity in normal ageing and pathological states
对正常衰老和病理状态下人脑活动的瞬时模式进行成像和建模
  • 批准号:
    566588-2021
  • 财政年份:
    2022
  • 资助金额:
    --
  • 项目类别:
    Vanier Canada Graduate Scholarship Tri-Council - Doctoral 3 years
Synthesis and Evaluation of Eu(II/III) Systems for Imaging Transient Hypoxia
用于瞬时缺氧成像的 Eu(II/III) 体系的合成与评价
  • 批准号:
    2714591
  • 财政年份:
    2022
  • 资助金额:
    --
  • 项目类别:
    Studentship
Imaging and modelling transient patterns of human brain activity in normal ageing and pathological states
对正常衰老和病理状态下人脑活动的瞬时模式进行成像和建模
  • 批准号:
    566588-2021
  • 财政年份:
    2021
  • 资助金额:
    --
  • 项目类别:
    Vanier Canada Graduate Scholarship Tri-Council - Doctoral 3 years
Whole-brain immunolabeling and 3D imaging of transient neurons in the developing mouse brain
发育中小鼠大脑中瞬时神经元的全脑免疫标记和 3D 成像
  • 批准号:
    563367-2021
  • 财政年份:
    2021
  • 资助金额:
    --
  • 项目类别:
    University Undergraduate Student Research Awards
Using single-molecule imaging of transient biomolecular interactions to probe conformational dynamics and gene expression mechanisms.
使用瞬时生物分子相互作用的单分子成像来探测构象动力学和基因表达机制。
  • 批准号:
    2440758
  • 财政年份:
    2020
  • 资助金额:
    --
  • 项目类别:
    Studentship
Study on photothermal conversion dynamics by means of femtosecond transient absorption imaging microspectroscopy
飞秒瞬态吸收成像显微光谱研究光热转换动力学
  • 批准号:
    19K05211
  • 财政年份:
    2019
  • 资助金额:
    --
  • 项目类别:
    Grant-in-Aid for Scientific Research (C)
Imaging Amphotericin B's Mechanism of Action with Transient Absorption Microscopy
使用瞬态吸收显微镜成像两性霉素 B 的作用机制
  • 批准号:
    9099045
  • 财政年份:
    2016
  • 资助金额:
    --
  • 项目类别:
CAREER: Multi-Physics Transient Holography: A Non-Intrusive Imaging Approach for the Identification of Structural Damage in Mechanical Systems
职业:多物理场瞬态全息术:一种用于识别机械系统结构损伤的非侵入式成像方法
  • 批准号:
    1453330
  • 财政年份:
    2015
  • 资助金额:
    --
  • 项目类别:
    Standard Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了