Motion-tolerant coded-exposure-pixel cameras for emerging computational photography applications (Phase I)
用于新兴计算摄影应用的运动容错编码曝光像素相机(第一阶段)
基本信息
- 批准号:561521-2021
- 负责人:
- 金额:$ 9.11万
- 依托单位:
- 依托单位国家:加拿大
- 项目类别:Idea to Innovation
- 财政年份:2021
- 资助国家:加拿大
- 起止时间:2021-01-01 至 2022-12-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Motion causes significant imaging artifacts, which become prohibitively large when complex computational photography algorithms are implemented on conventional cameras, as they often require the use of multiple video frames. Highly-specialized high-frame-rate image sensors can be used to perform CEP-like imaging without such artifacts. But such high-speed cameras are prone to high noise, excessive power consumption, and extremely high output data rate, and thus are typically bulky and very expensive. We are introducing an emerging class of coded-exposure pixel (CEP) image sensors, that keep motion artifacts low and eliminate other existing drawbacks by implementing exposure-time programmability for each individual pixel.Technically speaking, for each (relatively slow) frame readout many (fast) exposures are performed, with the photogenerated charge for each exposure directed to one of several accumulation nodes within the pixel, based on a pixel code. This simple in-pixel charge-sorting function comes at a cost of an inconsequential pixel area overhead (especially for stacked-wafer image sensors), but allows for implementing a very powerful set of computational photography applications, without the drawbacks of the other approaches. The objective of this project is to refine and commercialize our CEP image sensors - microchips that are at the heart of a new class of motion-tolerant computational cameras. CEP image sensors dynamically program the exposure time of each individual pixel as opposed to conventional cameras where all pixels are exposed to light over equal timeintervals.Specifically, we target three imaging capabilities: (1) adaptive-pixel-exposure imaging under wide-ranging illumination conditions, (2) dynamic 3D imaging, and (3) sub-surface imaging of translucent objects, all done for moving scenes but without exacerbating motion artifacts. These and many other transformative imaging technologies are studied within the field of computational photography, an area of computer vision where synergetic use of imaging and computation yields powerful vision capabilities.
运动导致显著的成像伪影,当在传统相机上实现复杂的计算摄影算法时,其变得过大,因为它们通常需要使用多个视频帧。高度专业化的高帧速率图像传感器可用于执行类似CEP的成像,而不会出现这种伪影。但是这种高速相机易于产生高噪声、过度功耗和极高的输出数据速率,因此通常体积庞大且非常昂贵。我们正在引入一类新兴的编码曝光像素(CEP)图像传感器,其通过为每个单独的像素实现实时可编程性来保持低运动伪影并消除其他现有缺点。(相对较慢)帧读出执行多次(快速)曝光,每次曝光的光生电荷被引导到像素内的几个累积节点之一,基于像素代码。这种简单的像素内电荷分选功能是以不重要的像素面积开销为代价的(特别是对于堆叠晶片图像传感器),但是允许实现一组非常强大的计算摄影应用,而没有其他方法的缺点。该项目的目标是完善和商业化我们的CEP图像传感器-微芯片是一类新的运动容忍计算相机的核心。CEP图像传感器动态编程每个像素的曝光时间,而传统相机的所有像素都在相同的时间间隔内曝光。具体来说,我们的目标是三种成像功能:(1)在宽范围照明条件下的自适应像素曝光成像,(2)动态3D成像,以及(3)半透明物体的亚表面成像,所有这些都是针对运动场景而完成的,但不会加剧运动伪像。这些和许多其他变革性的成像技术在计算摄影领域进行了研究,这是一个计算机视觉领域,其中成像和计算的协同使用产生了强大的视觉功能。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Genov, Roman其他文献
Nanostructured CMOS Wireless Ultra-Wideband Label-Free PCR-Free DNA Analysis SoC
- DOI:
10.1109/jssc.2014.2312571 - 发表时间:
2014-05-01 - 期刊:
- 影响因子:5.4
- 作者:
Jafari, Hamed Mazhab;Abdelhalim, Karim;Genov, Roman - 通讯作者:
Genov, Roman
Battery-less Tri-band-Radio Neuro-monitor and Responsive Neurostimulator for Diagnostics and Treatment of Neurological Disorders
- DOI:
10.1109/jssc.2016.2528999 - 发表时间:
2016-05-01 - 期刊:
- 影响因子:5.4
- 作者:
Kassiri, Hossein;Bagheri, Arezu;Genov, Roman - 通讯作者:
Genov, Roman
Chopper-Stabilized Bidirectional Current Acquisition Circuits for Electrochemical Amperometric Biosensors
- DOI:
10.1109/tcsi.2013.2248771 - 发表时间:
2013-05-01 - 期刊:
- 影响因子:5.1
- 作者:
Jafari, Hamed Mazhab;Genov, Roman - 通讯作者:
Genov, Roman
Seizure Suppression Efficacy of Closed-Loop Versus Open-Loop Deep Brain Stimulation in a Rodent Model of Epilepsy
- DOI:
10.1109/tnsre.2015.2498973 - 发表时间:
2016-06-01 - 期刊:
- 影响因子:4.9
- 作者:
Salam, M. Tariqus;Velazquez, Jose Luis Perez;Genov, Roman - 通讯作者:
Genov, Roman
Arbitrary-Waveform Electro-Optical Intracranial Neurostimulator With Load-Adaptive High-Voltage Compliance
- DOI:
10.1109/tnsre.2019.2900455 - 发表时间:
2019-04-01 - 期刊:
- 影响因子:4.9
- 作者:
Kassiri, Hossein;Chen, Fu Der;Genov, Roman - 通讯作者:
Genov, Roman
Genov, Roman的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Genov, Roman', 18)}}的其他基金
Centimeter-Scale Nuclear Magnetic Resonance (NMR) Spectrometer for Analysis of Biochemical Composition of Living Organisms
用于分析生物体生化成分的厘米级核磁共振 (NMR) 波谱仪
- 批准号:
RTI-2023-00291 - 财政年份:2022
- 资助金额:
$ 9.11万 - 项目类别:
Research Tools and Instruments
Transport-Aware Image Sensors
传输感知图像传感器
- 批准号:
RGPIN-2017-06931 - 财政年份:2021
- 资助金额:
$ 9.11万 - 项目类别:
Discovery Grants Program - Individual
Personalized Contingent Neurostimulation for Epilepsy by Machine Learning in Organic Brain Interfaces
通过有机脑接口中的机器学习对癫痫进行个性化偶然神经刺激
- 批准号:
549625-2020 - 财政年份:2020
- 资助金额:
$ 9.11万 - 项目类别:
Collaborative Health Research Projects
Transport-Aware Image Sensors
传输感知图像传感器
- 批准号:
RGPIN-2017-06931 - 财政年份:2020
- 资助金额:
$ 9.11万 - 项目类别:
Discovery Grants Program - Individual
Transport-Aware Image Sensors
传输感知图像传感器
- 批准号:
507957-2017 - 财政年份:2019
- 资助金额:
$ 9.11万 - 项目类别:
Discovery Grants Program - Accelerator Supplements
Transport-Aware Image Sensors
传输感知图像传感器
- 批准号:
RGPIN-2017-06931 - 财政年份:2019
- 资助金额:
$ 9.11万 - 项目类别:
Discovery Grants Program - Individual
Transport-Aware Image Sensors
传输感知图像传感器
- 批准号:
507957-2017 - 财政年份:2018
- 资助金额:
$ 9.11万 - 项目类别:
Discovery Grants Program - Accelerator Supplements
Transport-Aware Image Sensors
传输感知图像传感器
- 批准号:
RGPIN-2017-06931 - 财政年份:2018
- 资助金额:
$ 9.11万 - 项目类别:
Discovery Grants Program - Individual
Transport-Aware Image Sensors
传输感知图像传感器
- 批准号:
507957-2017 - 财政年份:2017
- 资助金额:
$ 9.11万 - 项目类别:
Discovery Grants Program - Accelerator Supplements
Transport-Aware Image Sensors
传输感知图像传感器
- 批准号:
RGPIN-2017-06931 - 财政年份:2017
- 资助金额:
$ 9.11万 - 项目类别:
Discovery Grants Program - Individual
相似海外基金
CMMI-EPSRC: Damage Tolerant 3D micro-architectured brittle materials
CMMI-EPSRC:耐损伤 3D 微结构脆性材料
- 批准号:
EP/Y032489/1 - 财政年份:2024
- 资助金额:
$ 9.11万 - 项目类别:
Research Grant
肺癌分子標的療法におけるDrug-Tolerant Persister細胞の役割
耐药持久细胞在肺癌分子靶向治疗中的作用
- 批准号:
23K24345 - 财政年份:2024
- 资助金额:
$ 9.11万 - 项目类别:
Grant-in-Aid for Scientific Research (B)
Investigating the Role of Drug Tolerant Persisters in Driving Colorectal Cancer Metastasis.
研究耐药性持续存在在驱动结直肠癌转移中的作用。
- 批准号:
491461 - 财政年份:2023
- 资助金额:
$ 9.11万 - 项目类别:
Fellowship Programs
Fault Tolerant Current Limiting Superconducting Cable for Cryo-Electrified Systems
用于低温电气化系统的容错限流超导电缆
- 批准号:
2890181 - 财政年份:2023
- 资助金额:
$ 9.11万 - 项目类别:
Studentship
Fault Tolerant Current Limiting Superconducting Cable for Cryo-Electrified Systems
用于低温电气化系统的容错限流超导电缆
- 批准号:
2894117 - 财政年份:2023
- 资助金额:
$ 9.11万 - 项目类别:
Studentship
CAREER: Towards Fault-tolerant Edge Computing for Cyber-Physical Systems: Distributed Primitives for Coordination under Cyber Attacks
职业:走向网络物理系统的容错边缘计算:网络攻击下协调的分布式原语
- 批准号:
2334021 - 财政年份:2023
- 资助金额:
$ 9.11万 - 项目类别:
Continuing Grant
CAREER: Design and Analysis of Low-Overhead Fault-Tolerant Quantum Circuits
职业:低开销容错量子电路的设计和分析
- 批准号:
2237356 - 财政年份:2023
- 资助金额:
$ 9.11万 - 项目类别:
Continuing Grant
CAREER: Towards Fault-tolerant Edge Computing for Cyber-Physical Systems: Distributed Primitives for Coordination under Cyber Attacks
职业:走向网络物理系统的容错边缘计算:网络攻击下协调的分布式原语
- 批准号:
2238020 - 财政年份:2023
- 资助金额:
$ 9.11万 - 项目类别:
Continuing Grant
GOALI: Data-driven design of recycling tolerant aluminum alloys incorporating future material flows
目标:数据驱动的可回收铝合金设计,结合未来的材料流
- 批准号:
2243914 - 财政年份:2023
- 资助金额:
$ 9.11万 - 项目类别:
Standard Grant
ERI: Fault-Tolerant Monitoring of Moving Clusters of Targets using Collaborative Unmanned Aerial Vehicles
ERI:使用协作无人机对移动目标群进行容错监控
- 批准号:
2301707 - 财政年份:2023
- 资助金额:
$ 9.11万 - 项目类别:
Standard Grant