I-Corps: Augmented Reality-Powered 3D Interactive Instructions

这个I-Corps项目更广泛的影响/商业潜力是开发增强现实（AR）驱动的3D交互式教学技术，广泛应用于积木玩具，家具，制造，建筑和教育服务行业。这些行业的产品变得越来越复杂，使用说明书混乱，可能会导致施工质量不佳或错过用户的教育机会。通过为客户提供先进的基于AR的指令，该技术有望帮助改进装配过程并增加教育信息。该技术的更广泛影响可能会影响教育，设计，游戏，医疗和其他行业。这个I-Corps项目基于为装配、制造、建筑和教育行业开发基于增强现实（AR）的技术。所提出的技术的应用程序已经原型化和评估。使用所提出的技术，物理装配可以引导虚拟零件。在该平台中，真实感物体遮挡技术揭示了逐步装配过程中实体零件与虚拟零件、用户真实的手与虚拟零件之间的真实空间关系。所提出的虚拟物理模型对齐是高度准确的使用各种AR配准方法。这些功能的集成使得AR指令可以用于大型，小型或微小的部件组装，通过组装工件（如积木玩具和家具）的工作原型进行验证，并通过定量测量配准和遮挡的准确性。此外，对所提出的技术的特征的启发式评估已经导致发现，该方法可以在增强部件可见性、心理模型与可视化之间的匹配、该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准。

The broader impact/commercial potential of this I-Corps project is the development of Augmented Reality (AR)-powered 3D interactive instruction technologies for broad applications in block toys, furniture, manufacturing, building construction, and educational services industries. The products in these industries are becoming increasingly complex and confusing instruction manuals can lead to poor construction or missed educational opportunities for users. By providing the customers with advanced AR-based instructions, the proposed technology is expected to help improve the assembly processes and increase the educational information. The broader impacts of the technology may impact education, design, gaming, medicine, and other industries. This I-Corps project is based on the development of an Augmented Reality (AR)-based technology for the assembly, manufacturing, construction, and education industries. Applications of the proposed technology have been prototyped and evaluated. Using the proposed technology, physical assembly may be guided by virtual parts. In this platform, the technology of realistic object occlusion reveals the true spatial relationships between physical and virtual parts and between users’ real hands and virtual parts, in the step-by-step assembly process. The proposed virtual-physical model alignment is highly accurate using various AR registration methods. The integration of these features makes AR instructions possible for large, small, or tiny parts assembly, validated through working prototypes for assembling artifacts such as block toys and furniture, and through quantitative measures of the accuracies of registration and occlusions. In addition, a heuristic evaluation of features of the proposed technology has led to findings that the method could advance AR instructions in terms of enhancing part visibility, the match between mental models and visualization, and the alignment of physical and virtual parts in perspective views and spatial transformations.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.