PFI: TT: A Handheld Virtual Reality-Based Device for Realistic Power Tool Feedback for Manufacturing Skills Training

这一创新-技术转化伙伴关系项目更广泛的影响/商业潜力在于它对制造业使用电动工具的实践技能培训的直接影响。通过弥合科学研究与实际应用之间的差距，该项目旨在将前沿科学发现转化为切实的解决方案，以应对制造技能培训中的现实挑战。 我们与制造业的行业和商业化专家的合作将提高生产力，提供方便的工具，降低成本，弥合制造业面临的技能差距。 该合作伙伴关系旨在瞄准，招聘和培训能够为制造业劳动力中虚拟现实高科技应用的创业教育做出贡献的个人。为了确保技术人才的可持续发展，该项目将与K-12教育资源研究所，妇女和少数民族工程计划合作。我们不仅将提高我们对虚拟技能培训如何实际实施的理解，而且还有可能通过扩大实践技能培训来彻底改变行业并改善生活。该项目旨在利用虚拟现实（VR）中的触觉和人工智能（AI）创建有效的学习环境，以复制物理现实，以解决制造业普遍存在的技能培训差距。重点是开发一个沉浸式学习环境，促进肌肉记忆的发展，并减少在现实生活中使用工具的学习曲线。为了使最终用户更容易使用该系统，将开发一个低代码无代码编写程序。 该研究将涉及捕捉3D用户和专家的运动模式，提供有价值的反馈，以提高他们的技能。反馈方式，如触觉，视觉和听觉线索将被开发，以减少认知负荷，衡量进展，并提高实践PowVRtool培训经验的保真度和价值。 一个广义的触觉设备，能够呈现各种电动工具的现实反馈，将开发和测试。这将通过利用机器学习算法来实现，该算法在虚拟环境中复制真实的手动工具的振动。通过这些努力，该项目预期的技术成果将改善培训经验，增加技能获取，并提高虚拟环境中动手电动工具培训的有效性。该奖项反映了NSF的法定使命，并已被认为值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。

The broader impact/commercial potential of this Partnerships for Innovation - Technology Translation (PFI-TT) project lies in its direct impact on hands-on skills training for the use of power tools in the manufacturing industry. By bridging the gap between scientific research and practical application, the project aims to translate cutting-edge scientific discoveries into tangible solutions that address real-world challenges in manufacturing skills training. Our partnership with industry and commercialization experts in the manufacturing sector will result in increased productivity, accessible tools, and reduced costs, bridging the skills gap faced in the manufacturing industry. This partnership aims to target, recruit, and train individuals who can contribute to entrepreneurial education in high technology applications of virtual reality in the manufacturing workforce. To ensure a sustainable pipeline of skilled individuals, the project will collaborate with the K-12 education resources institute, women, and minority engineering program. We will not only enhance our understanding of how virtual skills training can be practically implemented but also have the potential to revolutionize industries and improve lives by scaling hands-on skills training. The proposed project aims to create effective learning environments utilizing haptics and artificial intelligence (AI) in virtual reality (VR) to replicate physical reality to address the pervasive skills training gap in the manufacturing industry. The focus is on developing an immersive learning environment that facilitates the development of muscle memory and reduces the learning curve for using tools in real-life situations. To make the system more accessible to end-users, a low-code no-code authoring process will be developed. The research will involve capturing the movement patterns of both users and experts in 3D, providing valuable feedback to enhance their skills. Feedback modalities such as haptic, visual, and auditory cues will be developed to reduce cognitive load, measure progress, and enhance the fidelity and value of the hands-on PowVRtool training experience. A generalized haptic device, capable of rendering realistic feedback for various power tools, will be developed and tested. This will be achieved by utilizing machine learning algorithms that replicate the vibrations of real hand tools within a virtual environment. Through these efforts, the project anticipates technical results that will improve training experiences, increase skill acquisition, and enhance the effectiveness of hands-on power tool training in virtual environments.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.