RI: Small: Recovering Object 3D Shape and Material from Isolated Images
RI: Small: Recovering Object 3D Shape and Material from Isolated Images
批准号:
1421521
负责人:
Derek Hoiem
金额:
$47.66万
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2014
资助国家:
美国
项目状态:
已结题
起止时间:
2014-08-01 至 2019-07-31
中文摘要
这个项目提高了计算机从视觉传感器解读物体形状和材料的能力。该研究假设,通过将来自观察对象的视觉特征与来自数据集中的已知形状的对象进行匹配、传递已知形状以及对3D形状进行变形以更好地解释匹配特征的空间对应关系,可以估计完整的3D对象形状。这项研究代表了多个尺度的材料,分别编码了材料类别的图案中的小凸起和凹槽。由于图像属性来自形状、材质和照明的组合,因此该研究还涉及开发联合估计的算法。开发的技术可应用于自动化系统、个人和工业机器人、监控和安全、交通、图像检索、图像编辑和处理以及内容创作。该项目通过学生项目、课程开发以及涉及更广泛受众的研讨会和教程来促进教育。这项研究研究了3D形状和材质的改进表示,以及从一幅图像中恢复它们的方法。研究团队没有瞄准真实的模型,例如精确的曲面法线或BRDF参数,而是恢复了对对象识别、内容创建和其他任务有用的近似模型。有关3D对象形状的工作集中于将对象边界标记为遮挡、折叠或纹理/反照率,并将这些边界用作数据驱动方法的一部分,以恢复对象的完整3D模型。这项研究包括研究恢复构成物体的材料的丰富、多尺度表示的方法。这些方法利用照明的近似形状表示和近似表示来恢复对象在某一点的辐射特性的估计。这些算法建立了这些材料属性的地图,以模拟反照率的空间变化和大理石中的纹理等复杂现象。这项研究还涉及扩展这些方法,以报告捕捉树皮等形状纹理的空间变化的法线贴图。最后,研究了如何结合以图像为中心的地图来捕捉更多随机的、空间局部化的现象,如橘子皮上的凹坑。
英文摘要
This project improves a computer's ability to interpret the shape and material of objects from visual sensors. The research hypothesizes that full 3D object shape can be estimated by matching visual features from an observed object to an object of known shape from a dataset, transferring the known shape, and deforming the 3D shape to better account for spatial correspondences of matched features. The research represents materials at multiple scales, separately encoding little bumps and grooves from the patterns of material categories. Because image properties arise from the combination of shape, material, and illumination, the research also involves developing algorithms to jointly estimate. The developed technologies can be applied to automated systems, personal and industrial robotics, surveillance and security, transportation, image retrieval, image editing and manipulation, and content creation. The project contributes to education through student projects, course development, and workshops and tutorials involving a broader audience. The research investigates improved representations of 3D shape and material and methods to recover them from one image. Rather than aiming for veridical models, such as precise surface normals or BRDF parameters, the research team recovers approximate models that are useful for object recognition, content creation, and other tasks. The work on 3D object shape focuses on labeling object boundaries as occlusions, folds, or texture/albedo and using these boundaries as part of a data-driven approach to recover full 3D models of the objects. The research involves studying methods to recover rich, multiscale representations of the materials that compose objects. These methods exploit approximate shape representations and approximate representations of the illumination to recover estimates of radiometric properties of the object at a point. The algorithms build maps of these material properties to model spatial variation in albedo and complex phenomena like veins in marble. The research also involves extending these methods to report spatially varying normal maps that capture shape textures like the bark of trees. Finally, the research investigates how to incorporate image-centered maps to capture more random, spatially localized phenomena like the pits in orange peel.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
RI: Small: Semantic 3D Neural Rendering Field Models that are Accurate, Complete, Flexible, and Scalable
-
批准号:2312102
-
项目类别:Continuing Grant
-
资助金额:$60.0万
-
财政年份:2023
-
负责人:Derek Hoiem
-
依托单位:
SBIR Phase I: Analysis of Progress Photos for Indoor Construction Progress Monitoring
-
批准号:1819248
-
项目类别:Standard Grant
-
资助金额:$22.5万
-
财政年份:2018
-
负责人:Derek Hoiem
-
依托单位:
CAREER: Large-Scale Recognition Using Shared Structures, Flexible Learning, and Efficient Search
-
批准号:1053768
-
项目类别:Continuing Grant
-
资助金额:$50.0万
-
财政年份:2011
-
负责人:Derek Hoiem
-
依托单位:
RI: Medium: Collaborative Research: Physically Grounded Object Recognition
-
批准号:0904209
-
项目类别:Standard Grant
-
资助金额:$41.6万
-
财政年份:2009
-
负责人:Derek Hoiem
-
依托单位:
国内基金
海外基金
登录
查看更多内容
昼夜节律性small RNA在血斑形成时间推断中的法医学应用研究
-
批准号:
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2024
-
负责人:
-
依托单位:
tRNA-derived small RNA上调YBX1/CCL5通路参与硼替佐米诱导慢性疼痛的机制研究
-
批准号:
-
项目类别:省市级项目
-
资助金额:10.0万元
-
批准年份:2022
-
负责人:张祥忠
-
依托单位:
Small RNA调控I-F型CRISPR-Cas适应性免疫性的应答及分子机制
-
批准号:32000033
-
项目类别:青年科学基金项目
-
资助金额:24.0万元
-
批准年份:2020
-
负责人:林平
-
依托单位:
Small RNAs调控解淀粉芽胞杆菌FZB42生防功能的机制研究
-
批准号:31972324
-
项目类别:面上项目
-
资助金额:58.0万元
-
批准年份:2019
-
负责人:高学文
-
依托单位:
变异链球菌small RNAs连接LuxS密度感应与生物膜形成的机制研究
-
批准号:81900988
-
项目类别:青年科学基金项目
-
资助金额:21.0万元
-
批准年份:2019
-
负责人:毛梦莹
-
依托单位:
肠道细菌关键small RNAs在克罗恩病发生发展中的功能和作用机制
-
批准号:31870821
-
项目类别:面上项目
-
资助金额:56.0万元
-
批准年份:2018
-
负责人:陈江宁
-
依托单位:
基于small RNA 测序技术解析鸽分泌鸽乳的分子机制
-
批准号:31802058
-
项目类别:青年科学基金项目
-
资助金额:26.0万元
-
批准年份:2018
-
负责人:麻慧
-
依托单位:
Small RNA介导的DNA甲基化调控的水稻草矮病毒致病机制
-
批准号:31772128
-
项目类别:面上项目
-
资助金额:60.0万元
-
批准年份:2017
-
负责人:吴建国
-
依托单位:
基于small RNA-seq的针灸治疗桥本甲状腺炎的免疫调控机制研究
-
批准号:81704176
-
项目类别:青年科学基金项目
-
资助金额:20.0万元
-
批准年份:2017
-
负责人:赵继梦
-
依托单位:
水稻OsSGS3与OsHEN1调控small RNAs合成及其对抗病性的调节
-
批准号:91640114
-
项目类别:重大研究计划
-
资助金额:85.0万元
-
批准年份:2016
-
负责人:何祖华
-
依托单位: