CGV: Small: Collaborative Research: Sparse Reconstruction and Frequency Analysis for Computer Graphics Rendering and Imaging
CGV:小型:协作研究:计算机图形渲染和成像的稀疏重建和频率分析
基本信息
- 批准号:1115242
- 负责人:
- 金额:$ 25万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2011
- 资助国家:美国
- 起止时间:2011-10-01 至 2015-09-30
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
A broad range of problems in computer graphics rendering, appearance acquisition, and imaging, involve sampling, reconstruction, and integration of high-dimensional (4D-8D) signals. Real-time rendering of glossy materials and intricate lighting effects like caustics, for example, can require pre-computing the response of the scene to different light and viewing directions, which is often a 6D dataset. Similarly, image-based appearance acquisition of facial details, car paint, or glazed wood requires us to take images from different light and view directions. Even offline rendering of visual effects like motion blur from a fast-moving car, or depth of field, involves high-dimensional sampling across time and lens aperture. The same problems are also common in computational imaging applications such as light field cameras. While the PIs and others have made significant progress in subsequent analysis and compact representation for some of these problems, the initial full dataset must almost always still be acquired or computed by brute force which is prohibitively expensive, taking hours to days of computation and acquisition time, as well as being a challenge for memory usage and storage.The PIs' goal in this project is to make fundamental contributions that enable dramatically sparser sampling and reconstruction of these signals, before the full dataset is acquired or simulated. The key idea is to exploit the structure of the data that often lies in lower-frequency, sparse, or low-dimensional spaces. Their recent collaboration on a Fourier analysis of motion blur has shown that the frequency spectrum of dynamic scenes is sheared into a narrow wedge in the space-time domain. This enables novel sheared (not axis-aligned) filters and a sparse sampling. The PIs will build upon these preliminary results to develop a unified framework for frequency analysis and sparse data reconstruction of visual appearance in computer graphics. To these ends, they will first lay the theoretical foundations, including a novel frequency analysis of Monte Carlo integration and 5D space-time analysis of light fields. They will then develop efficient practical algorithms for a variety of problem domains, including sparse reconstruction of light transport matrices for relighting, sheared sampling and denoising for offline shadow rendering, time-coherent compressive sampling for appearance acquisition, and new approaches to computational photography and imaging.Broader Impacts: From a theoretical perspective, this project will develop a fundamental signal-processing analysis of light transport and appearance and imaging datasets, which will provide the foundation for further work not just in computer graphics but in signal-processing, computer vision, and image analysis as well. Project outcomes will apply to diverse sets of problems and will lead to transformative advances across the spectrum of rendering and imaging applications. The PIs will leverage existing collaborations with industry to transition the new technologies to practical production use. Outreach to K-12 students and the public will be enabled by a new science popularization blog that will leverage the public's excitement for advances in digital photography to introduce novel technical concepts, as well as by events such as the Computer Science Education Day for high school students at UC-Berkeley. The new algorithms and datasets resulting from this work will be made available to the research community; moreover, imaging algorithms will be released in open-source format to work with consumer digital and cell-phone cameras.
计算机图形绘制、外观获取和成像中的广泛问题涉及高维(4D-8D)信号的采样、重建和积分。 例如,实时渲染光泽材质和复杂的灯光效果(如焦散)可能需要预先计算场景对不同光线和观看方向的响应,这通常是一个6D数据集。 类似地,基于图像的面部细节、汽车油漆或上釉木材的外观采集要求我们从不同的光线和视图方向拍摄图像。 即使是离线渲染的视觉效果,如运动模糊从快速移动的汽车,或景深,涉及高维采样跨时间和透镜光圈。 同样的问题在诸如光场相机的计算成像应用中也是常见的。 虽然PI和其他人在这些问题中的一些问题的后续分析和紧凑表示方面取得了重大进展,但初始完整数据集几乎总是必须通过蛮力获取或计算,这是非常昂贵的,需要数小时到数天的计算和获取时间,以及内存使用和存储的挑战。PI在这个项目中的目标是做出基本的贡献,使显着稀疏采样,在采集或模拟完整数据集之前,这些信号的重建。 其关键思想是利用通常位于低频、稀疏或低维空间中的数据结构。 他们最近在运动模糊的傅立叶分析上的合作表明,动态场景的频谱在时空域中被剪切成一个狭窄的楔形。 这使得能够实现新颖的剪切(非轴对齐)滤波器和稀疏采样。 PI将建立在这些初步结果的基础上,开发一个统一的框架,用于频率分析和稀疏数据重建计算机图形学中的视觉外观。 为此,他们将首先奠定理论基础,包括蒙特卡罗积分的新频率分析和光场的5D时空分析。 然后,他们将为各种问题领域开发高效的实用算法,包括用于重新照明的光传输矩阵的稀疏重建、用于离线阴影渲染的剪切采样和去噪、用于外观采集的时间相干压缩采样,以及计算摄影和成像的新方法。从理论的角度来看,该项目将开发光传输和外观和成像数据集的基本信号处理分析,这不仅为计算机图形学的进一步工作提供了基础,也为信号处理、计算机视觉和图像分析提供了基础。 项目成果将适用于各种各样的问题,并将在渲染和成像应用领域带来变革性的进步。 PI将利用与行业的现有合作,将新技术过渡到实际生产使用。 一个新的科普博客将利用公众对数码摄影进步的兴奋来介绍新颖的技术概念,以及加州大学伯克利分校高中生计算机科学教育日等活动,为K-12学生和公众提供宣传。 这项工作产生的新算法和数据集将提供给研究界;此外,成像算法将以开源格式发布,以与消费者数码相机和手机相机配合使用。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Ravi Ramamoorthi其他文献
Modeling Membrane Dynamics in 3D using Discrete Differential Geometry
- DOI:
10.1016/j.bpj.2020.11.523 - 发表时间:
2021-02-12 - 期刊:
- 影响因子:
- 作者:
Cuncheng Zhu;Christopher T. Lee;Ravi Ramamoorthi;Padmini Rangamani - 通讯作者:
Padmini Rangamani
Efficient image-based methods for rendering soft shadows
用于渲染软阴影的高效基于图像的方法
- DOI:
10.1145/344779.344954 - 发表时间:
2000 - 期刊:
- 影响因子:0
- 作者:
Maneesh Agrawala;Ravi Ramamoorthi;A. Heirich;Laurent Moll - 通讯作者:
Laurent Moll
Supplementary: A Theory of Topological Derivatives for Inverse Rendering of Geometry
补充:几何逆向绘制的拓扑导数理论
- DOI:
- 发表时间:
2023 - 期刊:
- 影响因子:0
- 作者:
Ishit Mehta;Manmohan Chandraker;Ravi Ramamoorthi - 通讯作者:
Ravi Ramamoorthi
From the Rendering Equation to Stratified Light Transport Inversion
- DOI:
10.1007/s11263-011-0467-6 - 发表时间:
2011-06-07 - 期刊:
- 影响因子:9.300
- 作者:
Tian-Tsong Ng;Ramanpreet Singh Pahwa;Jiamin Bai;Kar-Han Tan;Ravi Ramamoorthi - 通讯作者:
Ravi Ramamoorthi
Residual path integrals for re-rendering
用于重新渲染的剩余路径积分
- DOI:
- 发表时间:
2024 - 期刊:
- 影响因子:0
- 作者:
Bing Xu;Tzu;Iliyan Georgiev;Trevor Hedstrom;Ravi Ramamoorthi - 通讯作者:
Ravi Ramamoorthi
Ravi Ramamoorthi的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Ravi Ramamoorthi', 18)}}的其他基金
Collaborative Research: HCC: Medium: Neural Materials for Realistic Computer Graphics
合作研究:HCC:媒介:用于逼真计算机图形的神经材料
- 批准号:
2212085 - 财政年份:2022
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
Collaborative Research: HCC: Medium: Differentiable Rendering for Computer Graphics
合作研究:HCC:媒介:计算机图形学的可微渲染
- 批准号:
2105806 - 财政年份:2021
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CHS: Medium: Collaborative Research: Fast Photorealistic Computer Graphics Rendering of Non-Smooth Surfaces
CHS:媒介:协作研究:非光滑表面的快速真实感计算机图形渲染
- 批准号:
1703957 - 财政年份:2017
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CHS: Small: Collaborative Research: Detailed Shape and Reflectance Capture with Light Field Cameras
CHS:小型:协作研究:使用光场相机捕获详细形状和反射率
- 批准号:
1617234 - 财政年份:2016
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
HCC: Large: Collaborative Research: Beyond Flat Images: Acquiring, Processing, and Fabricating Visually Rich Material Appearance
HCC:大型:协作研究:超越平面图像:获取、处理和制造视觉丰富的材料外观
- 批准号:
1451828 - 财政年份:2014
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CHS: Small: Collaborative Research: Sampling and Reconstruction for Computer Graphics Rendering and Imaging
CHS:小型:协作研究:计算机图形渲染和成像的采样和重建
- 批准号:
1420146 - 财政年份:2014
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CHS: Small: Collaborative Research: Sampling and Reconstruction for Computer Graphics Rendering and Imaging
CHS:小型:协作研究:计算机图形渲染和成像的采样和重建
- 批准号:
1451830 - 财政年份:2014
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
HCC: Large: Collaborative Research: Beyond Flat Images: Acquiring, Processing, and Fabricating Visually Rich Material Appearance
HCC:大型:协作研究:超越平面图像:获取、处理和制造视觉丰富的材料外观
- 批准号:
1011832 - 财政年份:2010
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CAREER: Mathematical and Computational Fundamentals of Visual Appearance for Computer Graphics
职业:计算机图形学视觉外观的数学和计算基础
- 批准号:
0924968 - 财政年份:2009
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
Collaborative Research: Theory and Algorithms for High Quality Real-Time Rendering and Lighting/Material Design in Computer Graphics
合作研究:计算机图形学中高质量实时渲染和灯光/材质设计的理论和算法
- 批准号:
0701775 - 财政年份:2007
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
相似国自然基金
昼夜节律性small RNA在血斑形成时间推断中的法医学应用研究
- 批准号:
- 批准年份:2024
- 资助金额:0.0 万元
- 项目类别:省市级项目
tRNA-derived small RNA上调YBX1/CCL5通路参与硼替佐米诱导慢性疼痛的机制研究
- 批准号:n/a
- 批准年份:2022
- 资助金额:10.0 万元
- 项目类别:省市级项目
Small RNA调控I-F型CRISPR-Cas适应性免疫性的应答及分子机制
- 批准号:32000033
- 批准年份:2020
- 资助金额:24.0 万元
- 项目类别:青年科学基金项目
Small RNAs调控解淀粉芽胞杆菌FZB42生防功能的机制研究
- 批准号:31972324
- 批准年份:2019
- 资助金额:58.0 万元
- 项目类别:面上项目
变异链球菌small RNAs连接LuxS密度感应与生物膜形成的机制研究
- 批准号:81900988
- 批准年份:2019
- 资助金额:21.0 万元
- 项目类别:青年科学基金项目
基于small RNA 测序技术解析鸽分泌鸽乳的分子机制
- 批准号:31802058
- 批准年份:2018
- 资助金额:26.0 万元
- 项目类别:青年科学基金项目
肠道细菌关键small RNAs在克罗恩病发生发展中的功能和作用机制
- 批准号:31870821
- 批准年份:2018
- 资助金额:56.0 万元
- 项目类别:面上项目
Small RNA介导的DNA甲基化调控的水稻草矮病毒致病机制
- 批准号:31772128
- 批准年份:2017
- 资助金额:60.0 万元
- 项目类别:面上项目
基于small RNA-seq的针灸治疗桥本甲状腺炎的免疫调控机制研究
- 批准号:81704176
- 批准年份:2017
- 资助金额:20.0 万元
- 项目类别:青年科学基金项目
水稻OsSGS3与OsHEN1调控small RNAs合成及其对抗病性的调节
- 批准号:91640114
- 批准年份:2016
- 资助金额:85.0 万元
- 项目类别:重大研究计划
相似海外基金
CGV: Small: Collaborative Research: Theories, algorithms, and applications of medial forms for shape analysis
CGV:小型:协作研究:形状分析的中间形式的理论、算法和应用
- 批准号:
1319944 - 财政年份:2013
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
CGV: Small: Collaborative Research: Immersive Visualization and 3D Interaction for Volume Data Analysis
CGV:小型:协作研究:用于体数据分析的沉浸式可视化和 3D 交互
- 批准号:
1319606 - 财政年份:2013
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
CGV: Small: Collaborative Research: Theories, algorithms, and applications of medial forms for shape analysis
CGV:小型:协作研究:形状分析的中间形式的理论、算法和应用
- 批准号:
1319573 - 财政年份:2013
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CGV: Small: Collaborative Research: Immersive Visualization and 3D Interaction for Volume Data Analysis
CGV:小型:协作研究:用于体数据分析的沉浸式可视化和 3D 交互
- 批准号:
1320046 - 财政年份:2013
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
CGV: Small: Collaborative Research: Diffractive masks and algorithms for light field capture
CGV:小型:协作研究:用于光场捕获的衍射掩模和算法
- 批准号:
1218411 - 财政年份:2012
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CGV: Small: Collaborative Research: Diffractive masks and algorithms for light field capture
CGV:小型:协作研究:用于光场捕获的衍射掩模和算法
- 批准号:
1218409 - 财政年份:2012
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
CGV: Small: Collaborative Research: Sparse Reconstruction and Frequency Analysis for Computer Graphics Rendering and Imaging
CGV:小型:协作研究:计算机图形渲染和成像的稀疏重建和频率分析
- 批准号:
1116303 - 财政年份:2011
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CGV: Small: Collaborative Research: AdaCID: Adaptive Coded Imaging and Displays
CGV:小型:协作研究:AdaCID:自适应编码成像和显示
- 批准号:
1116452 - 财政年份:2011
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CGV: Small: Collaborative Research: From Virtual to Real
CGV:小型:协作研究:从虚拟到真实
- 批准号:
1116296 - 财政年份:2011
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CGV: Small: Collaborative Research: From Virtual to Real
CGV:小型:协作研究:从虚拟到真实
- 批准号:
1116619 - 财政年份:2011
- 资助金额:
$ 25万 - 项目类别:
Standard Grant