Modality-specific crosstalk in multitasking: Evidence from modality compatibility in task switching

实验研究揭示了人类多任务处理的巨大性能成本。在本项目中，在优先项目“多重认知任务要求下的人类表现：从基本机制到优化任务调度”的背景下，我们关注使用任务切换范式的变体的串行多任务。在这个范例中，基本的发现是任务切换时的表现比重复时更差。这些转换成本已被用于在高阶任务表征（“任务集”）水平上对认知控制过程的参与进行索引。目前的个人PP项目旨在通过研究与序列任务切换背后的任务表征的结构、灵活性和可塑性有关的问题，特别强调模态特定效应（“模态兼容性”，MC），为PP的目标做出贡献。我们将MC定义为刺激模态与预期反应效果的模态相对应的程度（例如，听觉-声音任务映射将是模态兼容的，因为声音反应通常旨在产生听觉效果）。在第一个资助期，我们发现在两种不兼容的模态映射（如听觉-手动和视觉-声乐）之间切换时的切换成本比在两种兼容映射之间切换时的切换成本更大。我们的理论解释认为，多任务处理中的MC效应来源于“意指运动”学习（即学习反应效应偶然性和对反应效应的预期）。将MC的影响根植于人类行为控制的功能约束中，会带来广泛的实证方法，从而引发关于人类行为控制和任务集的情境特定灵活性和学习依赖可塑性的研究问题。具体而言，本研究旨在更好地理解(1)任务和映射是如何表征的（结构性问题），(2)任务和映射是如何在“自由选择”中自愿选择的（灵活性），以及(3)任务集是如何随着短期和长期实践而变化的（可塑性）。在第二个项目阶段，我们的目标是加深我们对多任务处理中特定于模态的交互的理解。首先，我们将模态映射的概念推广到不同的加工需求和实验范式，包括在“任务共享”情况下模态映射在参与者之间划分的条件。其次，我们探讨了MC在自由（“自愿”）回应方式选择中的作用。第三，我们研究了在串行任务（即映射）切换和同步双任务中从单一映射和混合映射实践迁移的边界条件。最后，我们还致力于扩大现有的合作关系并发展新的合作关系。

Experimental studies revealed robust performance costs in human multitasking. In the present project in the context of the Priority Program "Human Performance under Multiple Cognitive Task Requirements: From Basic Mechanisms to Optimized Task Scheduling", we focus on serial multitasking using variations of the task-switching paradigm. In this paradigm, the basic finding is that performance is worse in task switches than in repetitions. These switch costs have been taken to index the involvement of cognitive control processes at the level of higher-order task representations ("task sets"). The present individual PP project aims at contributing to the goals of the PP by examining issues pertaining to the structure, flexibility, and plasticity of the task representations underlying serial task switching, with a specific emphasis on modality-specific effects ("modality compatibility", MC). We define MC as occurring to the degree that the stimulus modality corresponds to the modality of the intended response effect (e.g. auditory-vocal task mappings would be modality compatible because vocal responses are typically intended to produce auditory effects). In the first funding period, we found that switch costs are larger when switching between two incompatible modality mappings (e.g. auditory-manual and visual-vocal) than when switching between two compatible mappings. Our theoretical account proposes that such effects of MC in multitasking derive from "ideomotor" learning (i.e. learning response-effect contingencies and anticipation of response effects). Rooting the influence of MC in the functional constraints of human action control invites a broad empirical approach that raises research issues referring to the context-specific flexibility and learning-dependent plasticity of human action control and task set. Specifically, this research aims at understanding better (1) how tasks and mappings are represented (structural issue), (2) how tasks and mappings can be selected voluntarily in "free choices" (flexibility), and (3) how task sets can change with short-term and long-term practice (plasticity). In the second project phase, we aim at deepening our understanding of modality-specific interactions in multitasking. First, we generalize the notion of MC to different processing requirements and experimental paradigms, including conditions in which the modality mappings are divided across participants in a “task sharing” situation. Second, we explore the role of MC in free ("voluntary") response modality choices. Third, we examine the boundary conditions for transfer from single-mapping and mixed-mapping practice both in serial task (i.e. mapping) switching and simultaneous dual tasks. Finally, we also aim to extend existing and develop new cooperative links.