CHS: Small: Understanding Human Performance Consequences of Using Headworn Displays for Large Assemblies

CHS：小型：了解在大型组件中使用头戴式显示器对人类表现的影响

• 批准号: 1718051
• 负责人: Joseph Gabbard
• 金额: $ 50万
• 依托单位: Virginia Polytechnic Institute and State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-08-15 至 2021-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1718051&HistoricalAwards=false
• 关键词: CHS; Small; Understanding; Human; Performance

The field of construction is increasingly interested in head worn displays (HWDs) that might provide construction workers with augmented reality (AR) information such as blueprints or overlaid annotations and instructions. However, these HWDs might not have the desired effects of improved safety and efficiency: they could instead interfere physically or mentally with the job at hand, reducing workers' situational awareness. This project is about better understanding the design and effects of AR HWDs for common construction tasks such as framing and sheathing. The team will work with industry partners to understand the needs and risks workers face in order to develop task-specific AR interfaces as well as ways to measure safety, efficiency, awareness, and satisfaction. They will then evaluate and refine both the interfaces and measures in a series of controlled experiments that evaluate the interfaces in a large motion-capture lab at the PIs' home institution. The goal is to provide a generally useful suite of tasks, interfaces, measures, and guidelines for AR HWDs in construction and beyond. The team will also partner with the Building Women in Construction organization to develop AR experiences for middle and high school students that use the technology for outreach and education. The team will start by working with a stakeholder group to develop meaningful metrics of efficiency using interviews and review of stakeholder quality control documents. Based on preliminary work, and the team's access to motion capture equipment, these are likely to go beyond time taken and errors made and include factors such as tool and material choice, positioning and use, and damage. They will also develop specific measures of situational awareness, workload, and usability based on existing guidelines and scales, conducting pilot user studies to refine them and ensure that they can be administered in the simulated environment. The interfaces and experimental testbed will be developed using the motion capture lab facilities and commodity AR HWD devices: developing both conformal and non-conformal AR interfaces at different levels of fidelity and at different scales; simulating the hazards and distractions of a real construction site through including real and simulated objects and noises; and developing methods to track both behavior and object use. These will be evaluated in a series of controlled experiments using a balanced Latin Squares design, varying the presentation of information (including a control version using paper blueprints) and the scale of the conformal elements relative to the task area. The team will compute metrics developed in earlier stages and conduct interviews to get at participants' subjective satisfaction, engagement, perceptions of usability, and ideas for improvements. For the education and outreach portions of the project, they will also develop a smaller-scale AR HWD exercise to support a spaghetti bridge construction task commonly used in schools.

建筑领域对头戴式显示器（HWD）越来越感兴趣，头戴式显示器（HWD）可以为建筑工人提供增强现实（AR）信息，诸如蓝图或覆盖的注释和指令。 然而，这些HWD可能不会产生提高安全性和效率的预期效果：它们反而会在身体或精神上干扰手头的工作，降低工人的情景意识。 这个项目是关于更好地理解AR HWD的设计和效果，用于常见的施工任务，如框架和护套。 该团队将与行业合作伙伴合作，了解工人面临的需求和风险，以开发特定任务的AR界面以及衡量安全性、效率、意识和满意度的方法。 然后，他们将在一系列受控实验中评估和改进界面和测量，这些实验在PI所在机构的大型运动捕捉实验室中评估界面。 我们的目标是提供一个普遍有用的任务，接口，措施和指导方针，AR HWD在建设和超越。 该团队还将与建筑业女性组织合作，为使用该技术进行推广和教育的初中和高中学生开发AR体验。该小组将首先与利益相关者小组合作，通过访谈和审查利益相关者质量控制文件，制定有意义的效率指标。 根据初步工作，以及团队对动作捕捉设备的使用，这些可能超出了所花费的时间和所犯的错误，还包括工具和材料选择、定位和使用以及损坏等因素。 他们还将根据现有的指导方针和规模制定情境感知、工作量和可用性的具体措施，进行试点用户研究以完善它们并确保它们可以在模拟环境中进行管理。 接口和实验测试平台将使用运动捕捉实验室设施和商品AR HWD设备开发：在不同的保真度水平和不同的尺度下开发共形和非共形AR接口;通过包括真实的和模拟的对象和噪声来模拟真实的建筑工地的危险和分心;并开发跟踪行为和对象使用的方法。 这些将在一系列对照实验中使用平衡拉丁方设计进行评估，改变信息的呈现方式（包括使用纸质蓝图的对照版本）和相对于任务区域的共形元素的比例。 该团队将计算在早期阶段开发的指标，并进行访谈，以获得参与者的主观满意度，参与度，对可用性的看法以及改进的想法。 至于教育及外展部分，他们亦会发展一个较小规模的AR HWD演习，以支援学校常用的意大利式桥梁建造工作。

项目成果

Towards an EEG Based Mental Workload Evaluation Method for Construction Workers’ HMD AR Use

• DOI: 10.1061/9780784482865.070
• 发表时间: 2020-11
• 作者: Yimin Qin;Tanyel Bulbul

Impact of information display on worker performance for wood frame wall assembly using AR HMD under different task conditions

• DOI: 10.1016/j.aei.2021.101423
• 发表时间: 2021-10
• 期刊: Adv. Eng. Informatics
• 作者: Yimin Qin;Eric T. Bloomquist;Tanyel Bulbul;Joe Gabbard;Kyle Tanous

Framing the Scene: An Examination of Augmented Reality Head Worn Displays in Construction Assembly Tasks

构建场景：检查建筑装配任务中的增强现实头戴式显示器

• DOI: 10.1109/vrw50115.2020.00246
• 发表时间: 2020
• 期刊: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW
• 作者: Bloomquist, Eric T.;Gabbard, Joseph L.;Tanous, Kyle;Qin, Yimin;Bulbul, Tanyel
• 通讯作者: Bulbul, Tanyel