I-Corps: Augmented Reality-Powered 3D Interactive Instructions

I-Corps：增强现实驱动的 3D 交互式指令

• 批准号: 2242432
• 负责人: Wei Yan
• 金额: $ 5万
• 依托单位: Texas A&M University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-11-15 至 2023-10-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2242432&HistoricalAwards=false
• 关键词: Corps; Augmented; Reality; Powered; 3D

The broader impact/commercial potential of this I-Corps project is the development of Augmented Reality (AR)-powered 3D interactive instruction technologies for broad applications in block toys, furniture, manufacturing, building construction, and educational services industries. The products in these industries are becoming increasingly complex and confusing instruction manuals can lead to poor construction or missed educational opportunities for users. By providing the customers with advanced AR-based instructions, the proposed technology is expected to help improve the assembly processes and increase the educational information. The broader impacts of the technology may impact education, design, gaming, medicine, and other industries. This I-Corps project is based on the development of an Augmented Reality (AR)-based technology for the assembly, manufacturing, construction, and education industries. Applications of the proposed technology have been prototyped and evaluated. Using the proposed technology, physical assembly may be guided by virtual parts. In this platform, the technology of realistic object occlusion reveals the true spatial relationships between physical and virtual parts and between users’ real hands and virtual parts, in the step-by-step assembly process. The proposed virtual-physical model alignment is highly accurate using various AR registration methods. The integration of these features makes AR instructions possible for large, small, or tiny parts assembly, validated through working prototypes for assembling artifacts such as block toys and furniture, and through quantitative measures of the accuracies of registration and occlusions. In addition, a heuristic evaluation of features of the proposed technology has led to findings that the method could advance AR instructions in terms of enhancing part visibility, the match between mental models and visualization, and the alignment of physical and virtual parts in perspective views and spatial transformations.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这个I-Corps项目的更广泛的影响/商业潜力是开发增强现实（AR）驱动的3D交互式教学技术，广泛应用于积木玩具、家具、制造业、建筑施工和教育服务行业。这些行业的产品正变得越来越复杂，令人困惑的说明手册可能导致施工不良或错过用户的教育机会。通过为客户提供先进的基于ar的指令，拟议的技术有望帮助改善装配过程并增加教育信息。这项技术的广泛影响可能会影响教育、设计、游戏、医药和其他行业。I-Corps项目的基础是为装配、制造、建筑和教育行业开发基于增强现实（AR）的技术。所提出的技术的应用已经原型化和评估。使用所提出的技术，物理装配可以由虚拟部件引导。在该平台中，逼真的物体遮挡技术揭示了在分步组装过程中，物理部件与虚拟部件之间以及用户真实的手与虚拟部件之间的真实空间关系。所提出的虚拟物理模型对准使用各种AR配准方法具有很高的精度。这些功能的集成使得AR指令可以用于大型，小型或微型零件组装，通过组装工件（如积木玩具和家具）的工作原型进行验证，并通过对注册和遮挡精度的定量测量进行验证。此外，对所提出技术的特征进行了启发式评估，发现该方法可以在增强部件可见性，心理模型与可视化之间的匹配以及透视视图和空间转换中物理和虚拟部件的对齐方面推进AR指令。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Multi-3D-Models Registration-Based Augmented Reality Instructions for Assembly

基于多 3D 模型注册的增强现实装配说明

• 发表时间: 2024
• 期刊: IEEE Conference on Virtual Reality + 3D User Interfaces Abstracts and Workshops (VRW
• 作者: Tuzun Canadinc, Seda;Yan, Wei
• 通讯作者: Yan, Wei