Haptic playback: A new approach to teaching of sensorimotor skills

本提案旨在进一步理解和应用触觉回放，这是一种通过触觉设备和视觉显示器向用户显示位置和力数据流的范例。这两种数据流对于感觉运动技能的习得都至关重要。PI将进行用户研究，开发触觉回放期间用户的新模型，以解释人类在触觉交互期间使用的空间任务和自适应机制。该模型将用于开发可证明正确的控制方案，以实现触觉回放。此外，将确定度量来量化培训的成功，并提出改进这些度量的控制器。PI还将探索如何通过显示与真实组织交互过程中记录的力和位置数据来使用触觉回放来补充现有的软组织模拟方法。随后，PI将利用这些发现开发一个牙科模拟器，用于协作课堂使用，并开发一个模拟器，用于向医疗专业人员教授颈静脉淋巴结评估。触觉回放将在康复领域产生影响，在康复领域，病人正在努力学习受疾病或损伤影响的感觉运动技能；在运动训练领域，运动员正在努力学习最有效的运动；在远程手术领域，可以向农村社区提供医疗服务。用预先记录的数据取代昂贵而复杂的虚拟现实模型的能力可以大大缩短开发此类应用程序所需的时间。

This proposal aims to further the understanding and applications of haptic playback, a paradigm for displaying both position and force data streams to the user, one through a haptic device and the other through a visual display. Both these data streams are crucial for sensorimotor skill acquisition. The PI will conduct user studies to develop a new model of a user during haptic playback to account for spatial tasks and adaptive mechanisms that humans use during haptic interaction. The model will be used to develop provably correct control schemes for implementing haptic playback. Furthermore, metrics will be identified to quantify the success of the training and propose controllers that improve these metrics. The PI will also explore how haptic playback can be used to supplement existing methods for soft tissue simulation by displaying force and position data recorded during interaction with real tissue. The PI will subsequently use these findings to develop a dental simulator for collaborative classroom use and a simulator to teach evaluation of jugular lymph nodes to medical professionals.Haptic playback will have an impact in areas such as rehabilitation, where a patient is trying to learn a sensorimotor skill that has been affected by a disease or an injury, sports training, where an athlete is trying to learn the most efficient motion, or remote surgery, where medical services can be provided to rural communities. The ability to replace costly and complex virtual reality models with pre-recorded data could drastically shorten the time needed to develop such applications.