Modality-specific crosstalk in multitasking: Evidence from modality compatibility in task switching

实验研究揭示了人类多任务处理的强大性能成本。在本项目的优先计划的背景下，“多认知任务要求下的人类表现：从基本机制到优化的任务调度”，我们专注于串行多任务使用的任务切换范式的变化。在这个范例中，基本的发现是，性能是更差的任务切换比重复。这些转换成本已被用于在高阶任务表征（“任务集”）的水平上对认知控制过程的参与进行索引。目前的个人PP项目的目的是通过研究有关的结构，灵活性和可塑性的任务表征基础串行任务切换的问题，特别强调特定的模态效应（“模态兼容性”，MC）的PP的目标。我们将MC定义为刺激模态对应于预期响应效果的模态的程度（例如，语音-语音任务映射将是模态兼容的，因为语音响应通常旨在产生听觉效果）。在第一个资助期内，我们发现，切换成本更大时，两个不兼容的模态映射（如语音手动和视觉声乐）之间切换时，比两个兼容的映射之间切换。我们的理论解释提出，这种影响MC在多任务处理来自“IDERANCE”学习（即学习响应效果的偶然性和预期的响应效果）。植根于MC的影响，在人类动作控制的功能限制，邀请一个广泛的实证方法，提出了研究问题，指的是特定于上下文的灵活性和学习依赖的可塑性，人类动作控制和任务集。具体而言，本研究旨在更好地理解（1）任务和映射如何表示（结构问题），（2）任务和映射如何在“自由选择”中自愿选择（灵活性），以及（3）任务集如何随着短期和长期实践而变化（可塑性）。在第二个项目阶段，我们的目标是加深我们对多任务处理中特定模式交互的理解。首先，我们概括了MC的概念，不同的处理要求和实验范式，包括条件中的模态映射被划分在一个“任务共享”的情况下，在参与者。其次，我们探讨MC在自由（“自愿”）反应方式选择中的作用。第三，我们研究了在串行任务（即映射）切换和同时双任务中，从单一映射和混合映射实践转移的边界条件。最后，我们还致力于扩大现有的合作联系并开发新的合作联系。

Experimental studies revealed robust performance costs in human multitasking. In the present project in the context of the Priority Program "Human Performance under Multiple Cognitive Task Requirements: From Basic Mechanisms to Optimized Task Scheduling", we focus on serial multitasking using variations of the task-switching paradigm. In this paradigm, the basic finding is that performance is worse in task switches than in repetitions. These switch costs have been taken to index the involvement of cognitive control processes at the level of higher-order task representations ("task sets"). The present individual PP project aims at contributing to the goals of the PP by examining issues pertaining to the structure, flexibility, and plasticity of the task representations underlying serial task switching, with a specific emphasis on modality-specific effects ("modality compatibility", MC). We define MC as occurring to the degree that the stimulus modality corresponds to the modality of the intended response effect (e.g. auditory-vocal task mappings would be modality compatible because vocal responses are typically intended to produce auditory effects). In the first funding period, we found that switch costs are larger when switching between two incompatible modality mappings (e.g. auditory-manual and visual-vocal) than when switching between two compatible mappings. Our theoretical account proposes that such effects of MC in multitasking derive from "ideomotor" learning (i.e. learning response-effect contingencies and anticipation of response effects). Rooting the influence of MC in the functional constraints of human action control invites a broad empirical approach that raises research issues referring to the context-specific flexibility and learning-dependent plasticity of human action control and task set. Specifically, this research aims at understanding better (1) how tasks and mappings are represented (structural issue), (2) how tasks and mappings can be selected voluntarily in "free choices" (flexibility), and (3) how task sets can change with short-term and long-term practice (plasticity). In the second project phase, we aim at deepening our understanding of modality-specific interactions in multitasking. First, we generalize the notion of MC to different processing requirements and experimental paradigms, including conditions in which the modality mappings are divided across participants in a “task sharing” situation. Second, we explore the role of MC in free ("voluntary") response modality choices. Third, we examine the boundary conditions for transfer from single-mapping and mixed-mapping practice both in serial task (i.e. mapping) switching and simultaneous dual tasks. Finally, we also aim to extend existing and develop new cooperative links.