PFI: TT: A Handheld Virtual Reality-Based Device for Realistic Power Tool Feedback for Manufacturing Skills Training

PFI：TT：一款基于虚拟现实的手持式设备，可为制造技能培训提供逼真的电动工具反馈

• 批准号: 2329804
• 负责人: Karthik Ramani
• 金额: $ 55万
• 依托单位: Purdue University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-09-15 至 2025-08-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2329804&HistoricalAwards=false
• 关键词: PFI; TT; Handheld; Virtual; Reality

The broader impact/commercial potential of this Partnerships for Innovation - Technology Translation (PFI-TT) project lies in its direct impact on hands-on skills training for the use of power tools in the manufacturing industry. By bridging the gap between scientific research and practical application, the project aims to translate cutting-edge scientific discoveries into tangible solutions that address real-world challenges in manufacturing skills training. Our partnership with industry and commercialization experts in the manufacturing sector will result in increased productivity, accessible tools, and reduced costs, bridging the skills gap faced in the manufacturing industry. This partnership aims to target, recruit, and train individuals who can contribute to entrepreneurial education in high technology applications of virtual reality in the manufacturing workforce. To ensure a sustainable pipeline of skilled individuals, the project will collaborate with the K-12 education resources institute, women, and minority engineering program. We will not only enhance our understanding of how virtual skills training can be practically implemented but also have the potential to revolutionize industries and improve lives by scaling hands-on skills training. The proposed project aims to create effective learning environments utilizing haptics and artificial intelligence (AI) in virtual reality (VR) to replicate physical reality to address the pervasive skills training gap in the manufacturing industry. The focus is on developing an immersive learning environment that facilitates the development of muscle memory and reduces the learning curve for using tools in real-life situations. To make the system more accessible to end-users, a low-code no-code authoring process will be developed. The research will involve capturing the movement patterns of both users and experts in 3D, providing valuable feedback to enhance their skills. Feedback modalities such as haptic, visual, and auditory cues will be developed to reduce cognitive load, measure progress, and enhance the fidelity and value of the hands-on PowVRtool training experience. A generalized haptic device, capable of rendering realistic feedback for various power tools, will be developed and tested. This will be achieved by utilizing machine learning algorithms that replicate the vibrations of real hand tools within a virtual environment. Through these efforts, the project anticipates technical results that will improve training experiences, increase skill acquisition, and enhance the effectiveness of hands-on power tool training in virtual environments.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

创新伙伴关系-技术转化（PFI-TT）项目的更广泛影响/商业潜力在于它对制造业中使用电动工具的动手技能培训的直接影响。通过弥合科学研究与实际应用之间的差距，该项目旨在将前沿科学发现转化为切实可行的解决方案，以应对制造技能培训中的现实挑战。我们与制造业的工业和商业化专家的合作将导致生产力的提高，工具的可访问性和成本的降低，弥合制造业面临的技能差距。这一合作伙伴关系的目标是招募和培训能够在制造业劳动力中为虚拟现实高科技应用的创业教育做出贡献的个人。为了确保技术人才的可持续输送，该项目将与K-12教育资源研究所、妇女和少数民族工程项目合作。我们不仅将加深对虚拟技能培训如何实际实施的理解，而且还将通过扩大动手技能培训的规模，有可能彻底改变行业和改善生活。该项目旨在利用虚拟现实（VR）中的触觉和人工智能（AI）创造有效的学习环境，以复制物理现实，以解决制造业普遍存在的技能培训差距。重点是开发一个沉浸式学习环境，促进肌肉记忆的发展，并减少在现实生活中使用工具的学习曲线。为了使最终用户更容易使用该系统，将开发一个低代码无代码编写过程。这项研究将包括在3D中捕捉用户和专家的运动模式，提供有价值的反馈以提高他们的技能。反馈方式，如触觉、视觉和听觉线索将被开发，以减少认知负荷，衡量进展，并提高实际PowVRtool培训经验的保真度和价值。一个通用的触觉装置，能够呈现现实的反馈各种电动工具，将开发和测试。这将通过利用机器学习算法在虚拟环境中复制真实手动工具的振动来实现。通过这些努力，该项目预计技术成果将改善培训经验，增加技能获取，并提高虚拟环境中动手电动工具培训的有效性。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。