AI as a moral crumple zone: The effects of AI-mediated communication on attribution and trust
AI as a moral crumple zone: The effects of AI-mediated communication on attribution and trust
复制标题
DOI：
10.1016/j.chb.2019.106190
复制
发表时间：
2020-05-01
影响因子：
9.9
通讯作者：
Jung, Malte
中科院分区：
文献类型：
--
作者：
Hohenstein, Jess;Jung, Malte
人工智能介导的通信（AI-MC）代表了一种新的范式，其中通信由智能系统增强或生成。随着AI-MC变得越来越普遍，重要的是要了解它对人类互动和人际关系的影响。以前的工作告诉我们，在人类与智能系统的交互中，错误归因是常见的，信任的发展和处理与人类之间的交互不同。这项研究在受试者之间使用了2（成功与不成功的对话）x 2（标准与人工智能中介的消息应用程序）的设计，以探索人工智能中介是否对归因和信任有任何影响。我们表明，人工智能生成的智能回复的存在有助于增加人类沟通者之间的信任，当事情出错时，人工智能似乎被视为强制代理，使其能够像道德崩溃区一样发挥作用，并减轻分配给其他人类沟通者的责任。这些发现表明，聪明的回答可以用来改善对话者之间的关系和对对话结果的看法。我们的研究结果还增加了现有的文献中关于感知代理智能代理说明，在这种类型的AI-MC，AI被认为是只有当通信出错的代理。
AI-mediated communication (AI-MC) represents a new paradigm where communication is augmented or generated by an intelligent system. As AI-MC becomes more prevalent, it is important to understand the effects that it has on human interactions and interpersonal relationships. Previous work tells us that in human interactions with intelligent systems, misattribution is common and trust is developed and handled differently than in interactions between humans. This study uses a 2 (successful vs. unsuccessful conversation) x 2 (standard vs. AI-mediated messaging app) between subjects design to explore whether AI mediation has any effects on attribution and trust. We show that the presence of AI-generated smart replies serves to increase perceived trust between human communicators and that, when things go awry, the AI seems to be perceived as a coercive agent, allowing it to function like a moral crumple zone and lessen the responsibility assigned to the other human communicator. These findings suggest that smart replies could be used to improve relationships and perceptions of conversational outcomes between interlocutors. Our findings also add to existing literature regarding perceived agency in smart agents by illustrating that in this type of AI-MC, the AI is considered to have agency only when communication goes awry.