Mixed Reality Laboratory Training Suite

混合现实实验室培训套件

• 批准号: 10010011
• 负责人: William Robinson Buras
• 金额: $ 14.99万
• 依托单位: TIETRONIX SOFTWARE, INC.
• 依托单位国家: 美国
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-09-05 至 2021-09-04
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10010011
• 关键词: 3-Dimensional; Android; Area; Augmented Reality; Awareness; Calibration; Cellular Phone; Client; Clinic; Clinical; Communicable Diseases; Communities; Companions; Competence; Complex; Computer software; Computers; Containment of Biohazards; Cues; Custom; Devices; Dimensions; Disease Outbreaks; Ebola; Education; Educational Curriculum; Educational process of instructing; Engineering; Ensure; Environment; Equipment; Familiarity; Future; Goals; Health; Home environment; Human; Immersion; Infectious Agent; Instruction; Knowledge; Laboratories; Laboratory Personnel; Laboratory Procedures; Laboratory Technicians; Language; Learning; Maintenance; Medical; Medical Device; Medicine; Modeling; Outcome; Pharmacologic Substance; Phase; Physical environment; Procedures; Process; Public Health; Publishing; Research; Research Project Grants; Resources; Safety; Serologic tests; Shipping; Small Business Innovation Research Grant; Standardization; System; Tablets; Technical Expertise; Techniques; Technology; Testing; Text; Time; Training; United States National Aeronautics and Space Administration; Virtual and Augmented reality; Visual; Work; animation; base; collaborative environment; college; cost; design; digital; experience; global health; good laboratory practice; head mounted display; innovation; instrumentation; interest; laboratory equipment; laboratory experience; learning materials; light weight; mixed reality; novel; operation; portability; professional atmosphere; prototype; recruit; research and development; safety practice; simulation; skill acquisition; skills; support tools; technology development; tool; usability; virtual environment; virtual reality

Abstract & Project Summary Laboratory training is a complex and labor-intensive process. The quality of laboratory procedure execution is critical for scientific validity, clinical utility and the overall safety of laboratory workers. Over the past few years Virtual and Augmented Reality (VR, AR), or in combination, Mixed Reality (MX) technologies have been a subject of great interest in the training community for the realism and interactivity provided. Evidence is emerging from published studies that AR/VR simulators provide high fidelity training experiences as well as instantaneous, unbiased, and valid assessment of technical skills for scientific and health related fields. Virtual reality training contributes to the development of skills relevant for real procedures and might shorten the learning curve for new procedures. VR training sessions can build familiarity with work environments, equipment and proper procedures can and build competency through retention prior to or in combination with traditional training. VR provides a digital environment in which the user interacts as if it in the real world. The more recent technology development, Augmented Reality (AR), has begun to prove a powerful tool for delivering complex curricula content in supportive and interactive way as well as offering intraprocedural guidance. AR differs from VR because the focus of the interaction of the performed task is within the real world instead of the digital environment. Thus, AR offers the opportunity of a digital, often interactive overlay onto a real environment. These layers of the virtual and physical environment are combined in a way that an immersive, interactive environment is experienced by the user. AR may have a strong potential in public health and clinical laboratory personnel in remote, low resource areas where infectious disease outbreaks or other medical crises occur. In the recent past the cost and complexity of developing virtual and augmented reality simulators limited their widespread distribution. This is quickly changing as commercial AR and VR technologies become more affordable and available to organizations and the public. We propose this innovative continuum of AR android smartphone/tablet applications for introductory education and orientation, and companion, immersive VR simulators for laboratory skills and procedures training. These along with the innovated “closed-loop” AR technologies developed by Tietronix for NASA over the past 10 years adds a dimension of procedural oversight, insuring not only effective execution, but also correct outcomes of laboratory procedures. These tools present digital environments where trainees can learn about laboratory equipment and standard operating procedures quickly and correctly, thereby enabling rapid creation of an effective laboratory workforce. The envisioned tools can be matured in Phases II and III to a platform where instructional designers themselves can create newer, novel VR and AR based laboratory training materials that can be deployed on commercially available VR/AR hardware platforms (including mobile, smartphone and tablets). These tools could be quickly setup or distributed in new laboratories, field-based clinics or remote, austere environments without software programming or the need for computer expertise. The Phase I R&D activities will investigate the feasibility, and then pilot an integrated toolset of AR and VR Training applications for the Baylor College of Medicine (BCM) Global Health Initiative’s Smart Pod “shipping container,” rapid-deploy clinic. Tietronix will utilize instructional material from BCM for a select set of procedures and practices to create virtual/augmented reality version of these procedures, along with 3D, interactive models of equipment, devices and instrumentation in the Smart Pod laboratories. The use of the Augmented Reality tools will enable trainers/educators to provide enhanced situational awareness during the laboratory procedures training by overlaying additional information such as instructions or graphical cues on top of the target system views (for example, operation or maintenance of complex laboratory equipment).

摘要和项目摘要 实验室培训是一个复杂的劳动密集型过程。实验室质量 程序执行对于科学有效性、临床实用性和整体安全性至关重要， 实验室工作人员在过去的几年里，虚拟和增强现实（VR，AR），或在 结合，混合现实（MX）技术一直是一个非常感兴趣的主题， 培训社区提供的现实主义和互动性。有证据表明， 发表的研究表明，AR/VR模拟器提供高保真的训练体验， 即时，公正，有效的评估技术技能，科学和健康 相关领域虚拟现实培训有助于发展与真实的 程序，并可能缩短新程序的学习曲线。VR培训课程可以 熟悉工作环境、设备和适当的程序， 通过在传统培训之前或与传统培训相结合的保留来提高能力。VR提供了一个 在数字环境中，用户就像在真实的世界中一样进行交互。最近的 技术发展，增强现实（AR），已经开始证明是一个强大的工具， 以支持和互动的方式提供复杂的课程内容， 术中指导。AR与VR不同，因为AR与VR之间的交互重点是 所执行的任务是在真实的世界中而不是在数字环境中。因此，AR提供了 数字化的、通常是交互式的叠加到真实的环境上的机会。的这些层 虚拟和物理环境以一种沉浸式、交互式 环境是由用户体验的。AR可能在公共卫生领域具有强大的潜力， 传染病暴发的偏远、资源匮乏地区的临床实验室人员 或发生其他医疗危机。在最近的过去，开发虚拟 增强现实模拟器限制了它们的广泛分布。这种情况正在迅速改变 随着商业AR和VR技术变得越来越便宜， 及公众 我们提出这种创新的AR android智能手机/平板电脑应用程序， 入门教育和指导，以及配套的实验室沉浸式VR模拟器 技能和程序培训。这些沿着创新的“闭环”AR技术 在过去的10年里，Tietronix为NASA开发了一个程序化的 监督，不仅确保有效执行，而且确保实验室的正确结果 程序.这些工具提供了数字环境，学员可以在其中了解实验室 快速、正确地使用设备和标准操作程序， 建立一支高效的实验室队伍。设想的工具可以在第二阶段成熟 和III到一个平台，教学设计师自己可以创建更新，新颖的VR， 基于AR的实验室培训材料，可部署在商用VR/AR上 硬件平台（包括移动的、智能手机和平板电脑）。这些工具可以迅速 在新的实验室、现场诊所或偏远、严峻的环境中设置或分布 无需软件编程或计算机专业知识。第一阶段研发活动 我将调查可行性，然后试点一个AR和VR培训的综合工具集 贝勒医学院（Baylor College of Medicine）全球健康倡议（Global Health Initiative）的Smart Pod 集装箱快速部署诊所Tietronix将使用来自Escherichia的指导材料， 一套精选的程序和做法，以创建虚拟/增强现实版本的这些 程序，沿着3D交互式设备模型，装置和仪器， Smart Pod实验室增强现实工具的使用将使培训人员/教育工作者能够 在实验室程序培训期间提供增强的态势感知， 将诸如指令或图形提示之类的附加信息覆盖在目标之上 系统视图（例如，复杂实验室设备的操作或维护）。