HCC: Medium: Haptic Simulation Design for Motor Rehabilitation and Skill Training

HCC：中：运动康复和技能训练的触觉模拟设计

• 批准号: 0905505
• 负责人: David Kaber
• 金额: $ 65.44万
• 依托单位: North Carolina State University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-07-01 至 2013-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0905505&HistoricalAwards=false
• 关键词: HCC; Medium; Haptic; Simulation; Design

The PI seeks to design and investigate novel features and strategies for use of virtual reality based haptic simulations to retrain impaired motor functions and train new fine motor skills in veterans (medics) with traumatic brain injury (TBI). Previous approaches to haptic simulation design have typically focused on completeness of presentation relative to reality. However, simulators may be used for many different tasks, so completeness may not ensure usefulness. The PIs argue that the role of the simulation for a user and its required functionality are the more important design questions, and that consideration of critical applications like motor skill training in haptic simulation design will promote effective design from a human performance perspective. Thus, they propose a cognitive-oriented approach to haptic simulation design and evaluation. In this project, the PIs will test their ideas by designing and prototyping advanced VR haptic simulators for drawing and surgical tasks. The simulations will be defined in terms of the type and resolution of (medical) data sources used for virtual object modeling, the type of visual and force presentation for motor skill and brain function assessment, and the approach to graphic and haptic rendering of the simulation. Through human factors experimentation with the simulations, the PIs will also assess interventional strategies for motor development, including virtual haptic aids (e.g., force boundaries and potentials) and force graduation across rehabilitation trials. Finally, they will validate the effect of the haptic simulations on neurocognitive and motor performance using behavioral indices and advanced magnetic resonance imaging (fMRI). Cognitive tasks analyses will be conducted with expert neuropsychologists and surgeons on psychomotor task performance and surgical operations to inform the simulation design process. Simulation design manipulations will include source data reduction through approximation of point-cloud data using graphical methods, development of a haptic-based motor skill training workstation with an effective human-computer interface, and optimization of visual and haptic representation using GPU-based graphics and a smoothed particle hydrodynamics (SPH) model for reduction of CPU overhead in haptic object rendering with force feedback. The simulation design will also reflect results on baseline motor performance and VR drawing and surgical simulator practice. This testing will be followed by fMRI of subjects in motor tasks in order to examine activation of brain regions mediating motor control. Subsequently, a series of motor training sessions will be conducted using the haptic simulators. Subjects will be exposed to the various settings of the simulation design parameters along with the virtual haptic aids and gradual reduction of force feedback, relative to nominal forces, across sessions. Post-therapy motor and simulator tests, as well as follow-up fMRI scanning, will be conducted. Motor recovery and neuroimaging of brain regions mediating motor performance will provide evidence of the effectiveness of the simulation design and rehabilitation efficacy. The PIs' hypothesize that experience with a haptic simulation design based on motor skill training demands and human performance metrics will accelerate skill development relative to a fidelity-centered approach to design. They also expect that haptic-simulator experience will improve fine motor control and motor planning (praxis), that experience on the drawing-simulation device will generalize to improved performance on the surgical-simulation device, and that brain blood flow will increase in regions mediating motor control.Broader Impacts: This work will make contributions to the design of computer graphics and haptic rendering, in terms of better understanding of optimal computational modeling for VR haptic simulation. It will also advance the state of the art in computer-based therapeutic approaches to motor skill development with haptic simulation, and enhance our understanding of brain-behavior relationships governing motor output and the nature of neural recovery following motor rehabilitation. Improvements in existing VR-based rehabilitation strategies for motor and praxis impairment in individuals suffering from TBI will be identified; rehabilitation treatment regimens will be identified that may have implications for various populations suffering from brain injuries (e.g., stroke patients).

PI旨在设计和研究使用基于虚拟现实的触觉模拟的新功能和策略，以重新训练受损的运动功能，并训练创伤性脑损伤（TBI）退伍军人（医务人员）的新精细运动技能。 以前的方法，触觉模拟设计通常集中在完整的演示相对于现实。 然而，模拟器可以用于许多不同的任务，因此完整性可能无法确保有用性。 PI认为，模拟用户的角色及其所需的功能是更重要的设计问题，并认为在触觉模拟设计中考虑运动技能训练等关键应用将从人类性能的角度促进有效的设计。 因此，他们提出了一种面向认知的方法来触觉仿真设计和评估。 在这个项目中，PI将通过设计和原型制作用于绘图和手术任务的高级VR触觉模拟器来测试他们的想法。 模拟将被定义在用于虚拟对象建模的（医疗）数据源的类型和分辨率方面，运动技能和脑功能评估的视觉和力呈现的类型，以及模拟的图形和触觉渲染的方法。 通过模拟的人为因素实验，PI还将评估运动发育的干预策略，包括虚拟触觉辅助（例如，力边界和潜力）和康复试验中的力分级。 最后，他们将使用行为指数和先进的磁共振成像（fMRI）来验证触觉模拟对神经认知和运动表现的影响。 认知任务分析将与神经心理学家和外科医生专家进行心理任务性能和外科手术，以告知模拟设计过程。 模拟设计操作将包括通过使用图形方法近似点云数据来减少源数据，开发具有有效人机界面的基于触觉的运动技能训练工作站，以及使用基于GPU的图形和平滑粒子流体动力学（SPH）模型优化视觉和触觉表示，以减少力反馈触觉对象渲染中的CPU开销。 模拟设计还将反映基线运动性能和VR绘图以及手术模拟器实践的结果。 该测试之后将对运动任务中的受试者进行fMRI，以检查介导运动控制的大脑区域的激活。 随后，将使用触觉模拟器进行一系列运动训练课程。 受试者将暴露于模拟设计参数的各种设置，沿着虚拟触觉辅助，并在整个会话中逐渐减少相对于标称力的力反馈。 将进行治疗后运动和模拟器测试以及随访fMRI扫描。 运动恢复和介导运动表现的大脑区域的神经成像将提供模拟设计和康复功效的有效性的证据。 PI假设，基于运动技能训练需求和人类表现指标的触觉模拟设计经验将加速相对于以能力为中心的设计方法的技能发展。 他们还期望，触觉模拟器体验将改善精细运动控制和运动规划（praxis），绘画模拟设备上的体验将推广到神经模拟设备上的性能改善，并且脑血流将增加介导运动控制的区域。更广泛的影响：本文的工作将有助于计算机图形学和触觉渲染的设计，在更好地理解VR触觉仿真的最佳计算建模。 它还将推进基于计算机的治疗方法与触觉模拟的运动技能发展的最新技术，并增强我们对控制运动输出的大脑行为关系和运动康复后神经恢复性质的理解。 将确定对患有TBI的个体的运动和实践障碍的现有基于VR的康复策略的改进;将确定可能对患有脑损伤的各种人群具有影响的康复治疗方案（例如，中风患者）。