Exploratory Application of Augmented Reality/Mixed Reality Devices for Acute Care Procedure Training.
Exploratory Application of Augmented Reality/Mixed Reality Devices for Acute Care Procedure Training.
复制标题
急性护理程序培训的增强现实/混合现实设备的探索性应用。
DOI：
10.5811/westjem.2017.10.35026
复制
发表时间：
2018-01
期刊：
影响因子：
--
通讯作者：
Merck DL
中科院分区：
文献类型：
--
作者：
Kobayashi L;Zhang XC;Collins SA;Karim N;Merck DL
增强现实（AR）、混合现实（MR）和虚拟现实设备是可以促进具有信息和知识的人（临床医生/专家;专家;教育者）与寻求理解和洞察力的人（患者/家属;非专家;学习者）之间在医疗保健中进行有效沟通的技术。研究者启动了一项探索性计划，以在急性护理临床和教学环境中研究AR/MR用例。学术临床教育工作者、计算机科学家和诊断成像专家进行了一项概念验证项目，以1）在研究机构实施核心全息成像管道基础设施和开放访问存储库，2）在现成设备上使用新型AR/MR技术，并通过基础设施生成全息图像，以展示其在复杂医学信息的指导性通信中的潜在作用。该研究小组成功开发了一种医学全息成像基础设施方法，用于识别、检索和操纵真实的患者的去识别计算机断层扫描和磁共振图像集，以将模块化全息图像渲染、打包、传输和显示到AR/MR头戴式设备和连接的显示器上。将包含颈部和胸部解剖结构和病理的关键分割的全息图像叠加并配准到物理任务训练器上，用于基于模拟的“盲插”侵入性手术训练。在会议期间，学习者体验并使用任务相关的解剖全息图像进行中心静脉导管和管胸廓造口术插入训练，增强视觉提示和触觉反馈。直接教师访问到学习者的AR/MR头戴式耳机的任务训练器的视图实现了视觉轴交互式教学指导。研究人员实施了核心全息成像管道基础设施和模块化开放访问存储库，以在探索性试点阶段应用程序中生成并访问模块化全息图像，用于侵入性程序培训，其特征是在现成的头戴式设备上采用创新的AR/MR技术。
Augmented reality (AR), mixed reality (MR), and virtual reality devices are enabling technologies that may facilitate effective communication in healthcare between those with information and knowledge (clinician/specialist; expert; educator) and those seeking understanding and insight (patient/family; non-expert; learner). Investigators initiated an exploratory program to enable the study of AR/MR use-cases in acute care clinical and instructional settings. Academic clinician educators, computer scientists, and diagnostic imaging specialists conducted a proof-of-concept project to 1) implement a core holoimaging pipeline infrastructure and open-access repository at the study institution, and 2) use novel AR/MR techniques on off-the-shelf devices with holoimages generated by the infrastructure to demonstrate their potential role in the instructive communication of complex medical information. The study team successfully developed a medical holoimaging infrastructure methodology to identify, retrieve, and manipulate real patients’ de-identified computed tomography and magnetic resonance imagesets for rendering, packaging, transfer, and display of modular holoimages onto AR/MR headset devices and connected displays. Holoimages containing key segmentations of cervical and thoracic anatomic structures and pathology were overlaid and registered onto physical task trainers for simulation-based “blind insertion” invasive procedural training. During the session, learners experienced and used task-relevant anatomic holoimages for central venous catheter and tube thoracostomy insertion training with enhanced visual cues and haptic feedback. Direct instructor access into the learner’s AR/MR headset view of the task trainer was achieved for visual-axis interactive instructional guidance. Investigators implemented a core holoimaging pipeline infrastructure and modular open-access repository to generate and enable access to modular holoimages during exploratory pilot stage applications for invasive procedure training that featured innovative AR/MR techniques on off-the-shelf headset devices.
登录
查看更多内容
影响因子：
3.9
作者：
Bifulco, Paolo;Narducci, Fabio;Romano, Maria
通讯作者：
Romano, Maria
影响因子：
2.3
作者：
Amini, Richard;Wyman, Michael T.;Adhikari, Srikar
通讯作者：
Adhikari, Srikar
影响因子：
2
作者：
Davis, Matthew Christopher;Can, Dang D.;Johnston, James M.
通讯作者：
Johnston, James M.
影响因子：
2.3
作者：
Hooten, Kristopher G.;Lister, J. Richard;Murad, Gregory J. A.
通讯作者：
Murad, Gregory J. A.
DOI：
10.1109/tvcg.2014.2377772
发表时间：
2015-05-01
影响因子：
5.2
作者：
Haouchine, Nazim;Cotin, Stephane;Berger, Marie-Odile
通讯作者：
Berger, Marie-Odile