Characterising visual context effects

Characterising visual context effects
复制标题

表征视觉上下文效果

DOI:
10.1075/aicr.93.09kno
复制
发表时间:
2016
期刊:
影响因子:
--
通讯作者:
Knoeferle
Knoeferle
中科院分区:
--
文献类型:
--
作者:
Knoeferle

文献摘要

参考文献

相似文献

在这一章中,我将回顾视觉情境语言理解的最新研究,并在此基础上确定情境语言理解的主要特征。更具体地说,我将论证,活跃的视觉语境效应以及视觉注意和语言理解之间的时间协调相互作用都是情境理解的特征,在广泛的理解情境中都是健壮的,跨越(A)不同的理解模式(阅读和口语理解)和语言与视觉语境(与不是)一致的情境;(B)不同类型的视觉语境(剪贴画、照片、真实世界的物体和事件);(C)基于说话者的信息,如眼睛凝视和手势;以及(D)具体和抽象的语言。情境语言理解范式因其覆盖面广((A)-(D)),原则上非常适合于发展一个相对全面的情境语言理解理论。进一步明确模型预测的一个挑战是在理解过程和用于检验情境理解(跨时间对物体的视觉注意)的关键测量之一之间发展更详细的联系假设。
In this chapter, I will review recent research on visually situated language comprehension, and in doing so identify key characteristics of situated language comprehension. More specifically I will argue that both active visual context effects and the temporally coordinated interplay between visual attention and language comprehension are characteristic of situated comprehension, and are robust across a broad range of comprehension situations, spanning (a) different comprehension modalities (reading and spoken comprehension) and situations in which language is (versus isn’t) in accord with visual context; (b) different kinds of visual contexts (clipart depictions, photographs, and real-world objects and events); (c) speaker-based information such as eye-gaze and gestures; and (d) both concrete and abstract language. Because of their broad coverage ((a)–(d)), situated language comprehension paradigms are, in principle, well suited for developing a relatively comprehensive theory of situated language comprehension. One challenge in further specifying model predictions is the development of more detailed linking hypotheses between comprehension processes and one of the key measures used to examine situated comprehension (visual attention to objects across time).
DOI: 10.1146/annurev.psych.093008.131123
发表时间: 2011
影响因子: 24.8
作者:
Kutas M;Federmeier KD
通讯作者: Federmeier KD
图句整合过程中不匹配的增量效应:来自眼动追踪的证据
DOI: --
发表时间: 2005
期刊:
影响因子: --
作者:
M. Crocker;P. Knoeferle
通讯作者: P. Knoeferle
DOI: 10.1207/s15516709cog0000_65
发表时间: 2006-05-01
期刊: COGNITIVE SCIENCE
影响因子: 2.5
作者:
Knoeferle, Pia;Crocker, Matthew W.
通讯作者: Crocker, Matthew W.
DOI: --
发表时间: --
期刊: --
影响因子: --
作者:
P. Engelhardt;F. Ferreira;Elena Patsenko
通讯作者: P. Engelhardt;F. Ferreira;Elena Patsenko
DOI: 10.1093/geronb/gbn036
发表时间: 2009-03-01
影响因子: 6.2
作者:
Isaacowitz, Derek M.;Allard, Eric S.;Schlangel, Mark
通讯作者: Schlangel, Mark