Collaborative Research: Immersive Virtual Reality with Haptic Feedback to Improve Safety Hazard Recognition, Assessment, and Decision-Making Among Construction Professionals

协作研究：具有触觉反馈的沉浸式虚拟现实可改善建筑专业人员的安全隐患识别、评估和决策

• 批准号: 1917763
• 负责人: Steven Ayer
• 金额: $ 50万
• 依托单位: Arizona State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-09-01 至 2023-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1917763&HistoricalAwards=false
• 关键词: Collaborative; Research; Immersive; Virtual; Reality

The construction industry accounts for hundreds of fatalities and hundreds of thousands of non-fatal injuries annually. The current modes of safety training do not effectively prepare practitioners to build safely. Research shows that safety learning occurs to a great extent through experiential learning - especially when individuals experience or witness an injury firsthand. While these experiences may be impactful for learning, it is impossible to wait for all practitioners to sustain (or witness) a serious injury in order to learn safe construction practices. Therefore, this work aims to explore the use of increasingly affordable virtual reality and haptic feedback technologies to provide realistic, yet safe, learning environments that aim to replicate the types of situations where injuries have historically occurred onsite. The research team will develop construction site training modules where participants may navigate a virtual job site with the aim of identifying safety hazards. Unlike prior virtual-reality-based safety training, when hazards go unnoticed, users will see, hear, and feel haptic feedback to simulate the ramifications of the missed hazard. The research team will collect data before, during, and after experimental treatments to determine the extent to which this mode of simulation supports safety learning among users. The team envisions this work providing evidence to guide both researchers and practitioners interested in using enhanced safety training simulations by studying how immersive virtual experiences can impact learners on a psychological level to make them care about safety in order to catalyze learning related to safe construction practices.The objectives of this research are to (1) create a novel and fully immersive Virtual Reality safety education environment that provides haptic feedback to users when hazards go unrecognized and unaddressed; (2) measure the extent to which instruction in this environment enhances learning outcomes in construction safety compared to traditional media; and (3) measure and explain the psychological mediators of cyberlearning in this multimedia-rich environment. The following research questions guide this study: How can haptic technology be incorporated with Virtual Reality technology to create an immersive visualization experience for construction safety education; and to what extent does Virtual Reality with haptic activate emotional arousal, generate situational awareness, and foster meaningful safety learning through multimedia? The experiment defined in this work will enable testing of explanatory hypotheses that examine the mediating roles of emotional arousal and situational interest in the cyberlearning process. Qualitative findings regarding multimedia learning will be explained using open-ended constructive interviews with the research subjects. This work will provide a novel approach for developing and using immersive cyberlearning experiences aimed at improving construction safety training. This will advance the body of knowledge related to designing cyberlearning environments, and will also provide empirical evidence of the ways in which this mode of education impacts safety learning. In terms of broad impact, this work directly aims to teach behaviors that will reduce injuries and save lives in construction. Furthermore, this work aims to target this form of learning using a scalable and cost-effective medium, which may broaden access to this critical form of cyberlearning.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

建筑业每年造成数百人死亡和数十万人非致命伤害。目前的安全培训模式并没有有效地使从业者做好安全建造的准备。研究表明，安全学习在很大程度上是通过经验式学习发生的--特别是当个人亲身经历或目睹伤害时。虽然这些经验可能会对学习产生影响，但不可能等待所有从业者遭受(或目睹)严重伤害才能学习安全的建筑实践。因此，这项工作旨在探索使用越来越负担得起的虚拟现实和触觉反馈技术，以提供现实而安全的学习环境，旨在复制历史上发生在现场的伤害类型。研究小组将开发建筑工地培训模块，参与者可以在虚拟工地导航，目的是识别安全危险。与之前基于虚拟现实的安全培训不同，当危险被忽视时，用户将看到、听到和感觉到触觉反馈，以模拟错过的危险的后果。研究小组将在实验治疗之前、期间和之后收集数据，以确定这种模拟模式在多大程度上支持用户的安全学习。通过研究身临其境的虚拟体验如何在心理水平上影响学习者，使他们关心安全，从而催化与安全施工实践相关的学习，团队设想这项工作将为有兴趣使用增强的安全培训模拟的研究人员和从业者提供证据。本研究的目标是(1)创建一个新颖的、完全沉浸式的虚拟现实安全教育环境，当危险未被识别和解决时，向用户提供触觉反馈；(2)测量与传统媒体相比，在这种环境中的教学在多大程度上提高了建筑安全的学习结果；以及(3)测量和解释在这个多媒体丰富的环境中，网络学习的心理中介。以下研究问题指导了本研究：如何将触觉技术与虚拟现实技术相结合，为建筑安全教育创造身临其境的可视化体验；以及具有触觉的虚拟现实在多大程度上激活了情感唤醒，产生了情境感知，并通过多媒体促进了有意义的安全学习？这项工作中定义的实验将能够测试解释性假设，这些假设考察了情绪唤醒和情景兴趣在网络学习过程中的中介作用。关于多媒体学习的定性结果将通过对研究对象的开放式建设性访谈来解释。这项工作将为开发和使用旨在改善建筑安全培训的沉浸式网络学习体验提供一种新的方法。这将促进与设计网络学习环境相关的知识体系，并将为这种教育模式影响安全学习的方式提供经验证据。就影响广泛而言，这项工作的直接目的是传授在建筑中减少伤害和拯救生命的行为。此外，这项工作旨在使用可扩展和经济高效的媒介来针对这种形式的学习，这可能会拓宽这种关键形式的网络学习的途径。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Analysis of YouTube Comments to Inform the Design of Virtual Reality Training Simulations to Target Emotional Arousal

• DOI: 10.1061/jcemd4.coeng-13245
• 发表时间: 2023-09
• 期刊: Journal of Construction Engineering and Management
• 影响因子: 5.1
• 作者: Karan R. Patil;S. Bhandari;Ameeta Agrawal;Steven K. Ayer;Logan A. Perry;Matthew R. Hallowell

Virtual Reality and Construction Industry: Review of Current State-of-Practice and Future Applications

虚拟现实和建筑行业：当前实践状况和未来应用回顾

• DOI: 10.1061/9780784483961.019
• 发表时间: 2022
• 期刊: and Data Analytics
• 作者: Lopez, Jazmin;Bhandari, Siddharth;Hallowell, Matthew R.
• 通讯作者: Hallowell, Matthew R.