STTR Phase I: Virtual Interfaces using Multi-Protocol, Augmented-Reality Activation-Based Control Transfer

STTR 第一阶段：使用多协议、基于增强现实激活的控制传输的虚拟接口

• 批准号: 2151524
• 负责人: Dominick Lee
• 金额: $ 25.6万
• 依托单位: GYROPALM, LLC
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-09-01 至 2023-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2151524&HistoricalAwards=false
• 关键词: STTR; Phase; Virtual; Interfaces; using

The broader impact/commercial potential of this Small Business Technology Transfer (STTR) Phase I project provides virtual interfaces that can be dynamically customized to address the challenge of user adoption in augmented reality (AR) products. This project overcomes previous limitations for AR such as the lack of interoperability, user-acceptance, scalability, and application-aware user intent recognition. While the AR market is projected to grow, wearable collaboration has unexplored potential. Users empowered by this project may be able to easily collaborate alongside skilled experts as well as robotic interfaces in the same medium. Through contextually-aware dynamic controls, manufacturing businesses can lower the risk of human-error while increasing fulfillment capabilities, as employees working from home can stay physically connected and remain engaged with minimal compromise. The AR innovation proposed in this project has application across multiple industries, including manufacturing, training, and emergency simulations.This Small Business Technology Transfer (STTR) Phase I project aims to create a framework for scalable experimentation of virtual interfaces that empower users to search, tag, and store meaningful data using gesture interactions in a secure and private manner. This project seeks to provide context-based, hands-free interaction with wireless devices while minimizing the need to set up sensors (such as optical components or microphones) in controlled environments and providing visual feedback and accessibility to the end user. A wrist-worn wearable captures pre-trained gesture data, and a pair of augmented reality (AR) glasses identifies and analyzes an object within the context of said gestures to control a mechatronic device, such as a robot, to perform occupational tasks. This dynamic process uses factors such as the user’s gaze area, physical location, and computer application. The improvement upon gesture control may allow a separate visual unit, such as the AR glasses, to wirelessly receive and display the gesture intents and perform contextually-aware, meaningful interactions with a clear distinction across a plurality of devices or digitally tagged objects associated with a specific use-case.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这个小型企业技术转移（STTR）I阶段项目的更广泛的影响/商业潜力提供了虚拟接口，可以动态自定义，以应对增强现实（AR）产品中用户采用的挑战。该项目克服了对AR的先前限制，例如缺乏互操作性，用户感知能力，可伸缩性和应用程序感知的用户意图识别。虽然AR市场预计会增长，但可穿戴的合作却没有探索潜力。该项目授权的用户可能能够轻松地与熟练的专家以及同一媒介中的机器人接口一起进行协作。通过情境意识的动态控制，制造业企业可以降低人性化的风险，同时提高满足能力，因为在家工作的员工可以保持身体上的联系并保持最小的妥协。该项目中提出的AR创新在多个行业中进行了应用，包括制造，培训和紧急模拟。此小型企业技术转移（STTR）I阶段项目旨在创建一个框架，以实验虚拟接口的可扩展实验，以使用户能够以安全和私人方式使用姿态互动来搜索，标签和存储有意义的数据。该项目旨在提供与无线设备的基于上下文的，免提的交互，同时最大程度地减少需要在受控环境中设置传感器（例如光学组件或麦克风）的需求，并为最终用户提供视觉反馈和可访问性。腕上戴的磨损可捕获预训练的手势数据，一对增强现实（AR）眼镜在上述手势的背景下识别并分析一个对象，以控制机器人的机器人，例如机器人，以执行占用任务。此动态过程使用了诸如用户目光区域，物理位置和计算机应用程序之类的因素。手势控制的改善可能会允许单独的视觉单元，例如Ar眼镜，可以无线接收和显示手势意图，并进行上下文意识到的，有意义的互动，并在多个设备上有明确区分的多个设备或数字标记的对象，或与特定用例相关的数字标记的对象，这些奖项通过NSF的智力依据和智力进行了评估，这表明了NSF的合法范围和依据，并具有良好的依据。 标准。