ITR: Collaborative Research: Image-Based Rendering in Forensic Science, Education, and Historical Preservation

ITR：协作研究：法医科学、教育和历史保护中基于图像的渲染

• 批准号: 0205425
• 负责人: Anselmo Lastra
• 金额: $ 119.08万
• 依托单位: University of North Carolina at Chapel Hill
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2002
• 资助国家: 美国
• 起止时间: 2002-10-01 至 2007-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0205425&HistoricalAwards=false
• 关键词: ITR; Collaborative; Research; Image; Based

Valuable information about the world around us is being lost. Every day we lose information of both current and historical significance, simply because it is too difficult to capture 3D models of our environment. Today, such models are primarily created by hand, making measurements with tape measures and entering the results manually. Even after models are constructed, we do not know the best ways to visualize them effectively.This research proposes to design and develop an end-to-end solution to the problem of documentation, dissemination, and display of real-world environments. To focus the research, two driving problems are targeted: forensic science and education. This research brings together an interdisciplinary team including the law enforcement community, the Federal Bureau of Investigation and the Armed Forces Institute of Pathology. Additionally, one of our team members, from the New Orleans Museum of Art, is directing a major exhibition in which we propose to include a virtual environment of Monticello, President Jefferson's home.We will tackle the problems of acquiring, processing, representing, rendering and display of real- world data, focusing on the two target applications. Our goal is to design and build a complete end-to-end prototype system. The work includes:Acquisition. We will mount an accurate rangefinder on a motorized cart and tackle the problem of capturing as complete a model as possible. This requires accurate tracking and a solution to the next best view problem in a practical sense, including resolution, reflectance, and importance of the surfaces.Processing. A very difficult problem is the registration of color with depth data, and of scans from multiple locations. We will develop algorithms to robustly register the data, and filter to reduce outliers and noise.Representation. We will develop algorithms to process the massive amounts of data (100 MB per scan, tens of scans per room) into both efficient geometric and image-based representations. We will compare and contrast the representations in terms of quality and efficiency.Rendering. We will develop hierarchical and out-of-core algorithms to render the image- based and geometric models at interactive rates, and research perceptually driven rendering techniques to maximize rendering efficiency.Display. This is perhaps the most difficult part of the problem because it involves the way humans perceive the environment. We will develop a hybrid projector/head-mounted-display system to provide stereo views to multiple viewers in a life-sized walking environment. The goal is to give the participants a sense of presence, of being in Mr. Jefferson's house.

关于我们周围世界的宝贵信息正在丢失。我们每天都会丢失具有当前和历史意义的信息，仅仅是因为捕获我们环境的3D模型太困难了。今天，这些模型主要是手工创建的，用卷尺测量并手动输入结果。即使模型构建后，我们不知道最好的方法来可视化他们effectively.本研究提出了设计和开发一个端到端的解决方案的问题的文档，传播和显示的真实世界的环境。为了集中研究，有两个驱动问题是有针对性的：法医科学和教育。这项研究汇集了一个跨学科的团队，包括执法界，联邦调查局和武装部队病理学研究所。此外，我们的一个团队成员，从新奥尔良艺术博物馆，是指导一个主要的展览，我们建议包括一个虚拟环境的蒙蒂塞洛，杰斐逊总统的家。我们将解决的问题，获取，处理，表示，渲染和显示的真实的世界的数据，重点放在两个目标应用程序。我们的目标是设计和构建一个完整的端到端原型系统。工作内容包括：收购。我们将在机动车上安装一个精确的测距仪，并解决尽可能完整地捕获模型的问题。这需要精确的跟踪和解决实际意义上的下一个最佳视图问题，包括分辨率、反射率和表面的重要性。一个非常困难的问题是颜色与深度数据的配准以及来自多个位置的扫描。我们将开发算法来稳健地注册数据，并过滤以减少离群值和噪声。我们将开发算法来处理大量的数据（每次扫描100 MB，每个房间数十次扫描），并将其转化为有效的几何和基于图像的表示。我们将在质量和效率方面比较和对比表示。渲染。我们将开发分层和核外算法，以交互速率渲染基于图像的模型和几何模型，并研究感知驱动的渲染技术，以最大限度地提高渲染效率。这可能是问题中最困难的部分，因为它涉及到人类感知环境的方式。我们将开发一个混合投影仪/头戴式显示器系统，以提供立体视图，以多个观众在一个真人大小的步行环境。我们的目标是让参与者有一种存在感，在杰斐逊先生的房子。