Toward Workload-Based Adaptive Automation: The Utility of fNIRS for Measuring Load in Multiple Resources in the Brain
Toward Workload-Based Adaptive Automation: The Utility of fNIRS for Measuring Load in Multiple Resources in the Brain
复制标题
DOI：
10.1080/10447318.2023.2266242
复制
发表时间：
2023-10-21
影响因子：
4.7
通讯作者：
Hayne，Lucas
中科院分区：
文献类型：
--
作者：
Hirshfield，Leanne M.;Wickens，Christopher;Hayne，Lucas
我们通过多资源理论的视角，研究了功能近红外光谱 (fNIRS) 在基于工作负载的自适应自动化中的实用性。我们重点关注不引人注目、响应能力、负载敏感性（低负载与高负载）和负载诊断性（区分负载类型）的标准。我们报告了一项大型荟萃审查，其中我们得出的结论是，只有少数研究适合评估复杂现实世界任务中的敏感性和诊断性。虽然这些表明 fNIRS 信号对负荷水平变化的分级（敏感性）足够敏感，但 fNIRS 对不同认知负荷来源的诊断仍然不确定。我们通过工作记忆负荷（WM）和视觉感知负荷（VL）来操纵复杂形状分类任务的心理负荷，同时辅助听觉任务贯穿始终。我们使用传统的辅助和眼球追踪工作负荷测量方法，以及大脑特定功能区域的血流动力学反应，测量了这些操作在群体层面的效果，包括涉及多任务处理 (MT)、VL、WM 和听觉负荷 (AL) 的区域。我们的研究结果表明，fNIRS 对复杂任务的负荷既敏感又具有诊断性，脱氧血红蛋白比氧合血红蛋白显示出更高的敏感性，并且与诊断性相关的大脑区域与关于感知负荷、WM 和目标导向多任务处理的神经科学文献一致。
We investigate the utility of functional near-infrared spectroscopy (fNIRS) for workload-based adaptive automation through the lens of multiple resource theory. We focus on the criteria of unobtrusiveness, responsiveness, load sensitivity (low vs high load), and load diagnosticity (differentiating types of load). We report a large meta-review, in which we conclude that only a few studies were suitable for evaluating sensitivity and diagnosticity in complex real-world tasks. While these reveal that the fNIRS signal is adequately sensitive to gradations of load level changes (sensitivity), the diagnosticity of fNIRS to different sources of cognitive load remained uncertain. We manipulated mental load of a complex shape sorting task via working memory load (WM) and visual perceptual load (VL), while a secondary auditory task was present throughout. We measured the effect of these manipulations at the group-level using conventional secondary and eyetracking workload measures, as well as hemodynamic response in specific functional regions in the brain, including regions involved in multi-tasking (MT), VL, WM, and auditory load (AL). Our findings revealed that fNIRS is both sensitive and diagnostic to load in complex tasks, with greater sensitivity revealed by deoxyhemoglobin than oxyhemoglobin and the brain regions associated with diagnosticity align with neuroscience literature on perceptual load, WM, and goal-directed multitasking.