SBIR Phase I: Interactive 3-D Technical Illustrations for Science and Engineering

这个小企业创新研究（SBIR）第一阶段项目将开发和商业化工具，用于创建和显示STEM相关主题的交互式3D技术插图。该项目采用了一种新的方法来解决这个问题，通过应用基于图像的建模和渲染（IBMR）技术，使高度逼真的数字3D场景的创建通过处理和重新存储用相机捕获的图像。特别是，通过这项工作开发的技术将使广泛的交互式三维可视化，目前提供的视频压缩算法和二维矢量动画工具服务不佳。该提案的第一个目标是开发用于捕获、压缩和显示这些类型的数据集的方法和算法。第二个目标是开发一个原型数字教科书章节，将补充光学物理课。本章将包括解释折射、反射、色散和衍射基本理论的交互式模块，其次是应用课程，介绍如何通过现代相机操纵和测量光线，以及宝石的几何和材料特性如何产生其丰富的外观。该项目的更广泛的影响/商业潜力是开发技术，将改变~$8.7B市场的教育教科书，取代纸质教科书与数字版本。 这种转变目前停滞不前，因为大多数数字教科书提供商只是简单地扫描现有教科书的页面。虽然这些“玻璃下的书”比物理书籍更便携，更便宜，但它们忽视了真正互动材料的前景。我们认为这主要是由于目前缺乏用于创建和渲染移动的设备最近才有能力处理的3-D内容类型的工具。通过该项目开发的技术将在直接内容创作、咨询服务和许可费方面产生商业机会。该核心技术还将在文化遗产、消费者营销和广告领域得到应用。

This Small Business Innovation Research (SBIR) Phase I project will develop and commercialize tools for creating and displaying interactive 3-D technical illustrations for STEM-related topics. This project takes a new approach to the problem by applying Image-Based Modeling and Rendering (IBMR) techniques which enable the creation of highly realistic digital 3-D scenes by processing and resampling images captured with a camera. In particular, the technology developed through this effort will enable a wide range of interactive 3-D visualizations that are currently poorly served by available video compression algorithms and 2-D vector-based animation tools. The first goal of the proposal is to develop methods and algorithms for capturing, compressing, and displaying these types of datasets. The second goal is to develop a prototype digital textbook chapter that will supplement a physics class on Optics. This chapter will include interactive modules explaining the basic theory of refraction, reflection, dispersion and diffraction, followed by applied lessons on how light is manipulated and measured by a modern camera and how the geometric and material properties of gemstones give rise to their rich appearance.The broader impact/commercial potential of this project is to develop technology that will transform the ~$8.7B market for education textbooks by replacing paper textbooks with digital versions. This transition is currently stalled because the majority of digital textbook providers are simply scanning the pages of existing textbooks. Although these "books beneath glass" are more portable and less expensive than their physical counterparts, they neglect the promising opportunity for truly interactive material. We believe this is largely due to the current lack of tools for creating and rendering the type of 3-D content that mobile devices have only recently become capable of processing. The technology developed through this project will generate business opportunities in direct content creation, consulting services, and licensing fees. The core technology will also have applications in the areas of cultural heritage, consumer marketing, and advertising.