PFI: TT: A Handheld Virtual Reality-Based Device for Realistic Power Tool Feedback for Manufacturing Skills Training

这一创新-技术转化伙伴关系(PFI-TT)项目更广泛的影响/商业潜力在于它对制造业使用电动工具的实践技能培训产生了直接影响。通过弥合科学研究和实际应用之间的差距，该项目旨在将尖端科学发现转化为切实的解决方案，以应对制造技能培训方面的现实挑战。我们与制造业行业和商业化专家的伙伴关系将提高生产率、获得工具并降低成本，缩小制造业面临的技能差距。这一合作伙伴关系旨在瞄准、招聘和培训能够在制造业劳动力中应用虚拟现实的高科技应用方面为创业教育做出贡献的个人。为了确保技能人才的可持续输送，该项目将与K-12教育资源研究所、妇女和少数族裔工程项目合作。我们不仅将加深对虚拟技能培训如何实际实施的理解，还将有潜力通过扩大动手技能培训来变革行业和改善生活。拟议的项目旨在利用虚拟现实(VR)中的触觉和人工智能(AI)来复制物理现实来创建有效的学习环境，以解决制造业普遍存在的技能培训缺口。重点是开发一种身临其境的学习环境，促进肌肉记忆的发展，并减少在现实生活中使用工具的学习曲线。为了使终端用户更容易访问该系统，将开发一种低代码、无代码的创作过程。这项研究将包括捕捉用户和专家的3D运动模式，提供有价值的反馈以提高他们的技能。将开发触觉、视觉和听觉提示等反馈模式，以减少认知负荷，衡量进度，并增强动手Power VR工具培训体验的保真度和价值。将开发和测试一种通用触觉设备，能够为各种电动工具提供逼真的反馈。这将通过利用机器学习算法在虚拟环境中复制真实手动工具的振动来实现。通过这些努力，该项目期望技术成果将改善培训体验，增加技能获得，并增强虚拟环境中动手电动工具培训的有效性。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact/commercial potential of this Partnerships for Innovation - Technology Translation (PFI-TT) project lies in its direct impact on hands-on skills training for the use of power tools in the manufacturing industry. By bridging the gap between scientific research and practical application, the project aims to translate cutting-edge scientific discoveries into tangible solutions that address real-world challenges in manufacturing skills training. Our partnership with industry and commercialization experts in the manufacturing sector will result in increased productivity, accessible tools, and reduced costs, bridging the skills gap faced in the manufacturing industry. This partnership aims to target, recruit, and train individuals who can contribute to entrepreneurial education in high technology applications of virtual reality in the manufacturing workforce. To ensure a sustainable pipeline of skilled individuals, the project will collaborate with the K-12 education resources institute, women, and minority engineering program. We will not only enhance our understanding of how virtual skills training can be practically implemented but also have the potential to revolutionize industries and improve lives by scaling hands-on skills training. The proposed project aims to create effective learning environments utilizing haptics and artificial intelligence (AI) in virtual reality (VR) to replicate physical reality to address the pervasive skills training gap in the manufacturing industry. The focus is on developing an immersive learning environment that facilitates the development of muscle memory and reduces the learning curve for using tools in real-life situations. To make the system more accessible to end-users, a low-code no-code authoring process will be developed. The research will involve capturing the movement patterns of both users and experts in 3D, providing valuable feedback to enhance their skills. Feedback modalities such as haptic, visual, and auditory cues will be developed to reduce cognitive load, measure progress, and enhance the fidelity and value of the hands-on PowVRtool training experience. A generalized haptic device, capable of rendering realistic feedback for various power tools, will be developed and tested. This will be achieved by utilizing machine learning algorithms that replicate the vibrations of real hand tools within a virtual environment. Through these efforts, the project anticipates technical results that will improve training experiences, increase skill acquisition, and enhance the effectiveness of hands-on power tool training in virtual environments.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.