The influence of input modality and output modality on multitasking in language-related tasks

点击翻译按钮获取中文摘要

The use of language applies different input modalities (auditory in spoken and visual in written language) as well as different output modalities (vocal in spoken and visual in written or signed language). The present DFG project examines modality-specific influences in language-related tasks. Yet, the focus is neither on specific input modalities nor on specific output modalities but rather on the combination of different modalities. The general aim is to explore in which way the performance in language-related multitasking can be increased. More specifically, a performance increase is possible in two ways. On the one hand, the compatibility of input modality and output modality is important (input-output-modality-compatibility) and on the other hand, different languages can be combined with different output modalities (bimodal advantage). Both effects can be based on a reduction of interference between tasks or languages; the specific mechanisms, however, are still poorly understood. Therefore, the aim of the DFG project is the systematic examination and explanation of modality-specific influences. The two effects mentioned above will be explored in isolation but will also be integrated in order to gain a greater understanding of modality-specific effects. By doing so both monolingual and bilingual multitasking will be in the focus of the DFG project.