Visual resemblance and interaction history jointly constrain pictorial meaning.
Visual resemblance and interaction history jointly constrain pictorial meaning.
复制标题
DOI：
10.1038/s41467-023-37737-w
复制
发表时间：
2023-04-17
影响因子：
16.6
通讯作者：
Fan, Judith E.
中科院分区：
文献类型：
--
作者：
Hawkins, Robert D.;Sano, Megumi;Goodman, Noah D.;Fan, Judith E.
从详细的插图到示意性的插图，如何可靠地传达意义？查看者是否根据图纸与实体的相似程度来理解图纸（即，作为图像）或基于社会中介的约定（即，作为符号）？在这里，我们评估的认知帐户的图像意义，视觉和社会信息共同支持视觉沟通。成对的参与者使用图画在多个干扰物对象之间反复传达目标对象的身份。我们在三个实验和一个完整的复制过程中操纵了社交线索，发现参与者开发了特定于对象和特定于互动的策略，随着时间的推移，这些策略可以更有效地进行沟通，这超出了任务实践或基于随机性的解释所能解释的。利用基于模型的图像分析和众包注释，我们进一步确定图纸并没有像纯粹基于传统的帐户所预测的那样走向“任意性”，而是保留了视觉诊断功能。总之，这些发现推进了成功的图形惯例如何出现的心理学理论。图纸可以在抽象的同时仍然有意义。在这里，作者利用一个两个玩家的绘画游戏来评估认知帐户的图像意义，其中视觉和社会信息共同支持视觉沟通。
How do drawings—ranging from detailed illustrations to schematic diagrams—reliably convey meaning? Do viewers understand drawings based on how strongly they resemble an entity (i.e., as images) or based on socially mediated conventions (i.e., as symbols)? Here we evaluate a cognitive account of pictorial meaning in which visual and social information jointly support visual communication. Pairs of participants used drawings to repeatedly communicate the identity of a target object among multiple distractor objects. We manipulated social cues across three experiments and a full replication, finding that participants developed object-specific and interaction-specific strategies for communicating more efficiently over time, beyond what task practice or a resemblance-based account alone could explain. Leveraging model-based image analyses and crowdsourced annotations, we further determined that drawings did not drift toward “arbitrariness,” as predicted by a pure convention-based account, but preserved visually diagnostic features. Taken together, these findings advance psychological theories of how successful graphical conventions emerge. Drawings can vary in abstraction while still being meaningful. Here, the authors leverage a two-player drawing game to evaluate a cognitive account of pictorial meaning in which both visual and social information jointly support visual communication.
登录
查看更多内容
影响因子：
3.8
作者：
Fay N;Lister CJ;Ellison TM;Goldin-Meadow S
通讯作者：
Goldin-Meadow S
影响因子：
8.2
作者：
Bloom, P;Markson, L
通讯作者：
Markson, L
创建视觉解释可以改善学习。
DOI：
10.1186/s41235-016-0031-6
发表时间：
2016
期刊：
Cognitive research: principles and implications
影响因子：
--
作者：
Bobek E;Tversky B
通讯作者：
Tversky B
影响因子：
3.4
作者：
CLARK, HH;WILKESGIBBS, D
通讯作者：
WILKESGIBBS, D
DOI：
10.1098/rspb.2022.0066
发表时间：
2022-03-09
期刊：
Proceedings. Biological sciences
影响因子：
--
作者：
Fay N;Walker B;Ellison TM;Blundell Z;De Kleine N;Garde M;Lister CJ;Goldin-Meadow S
通讯作者：
Goldin-Meadow S