Using chatbots against voice spam: Analyzing Lenny's effectiveness

Using chatbots against voice spam: Analyzing Lenny's effectiveness
复制标题

使用聊天机器人对抗语音垃圾邮件:分析 Lenny 的有效性

DOI:
--
复制
发表时间:
2017
期刊:
Symposium On Usable Privacy and Security
影响因子:
--
通讯作者:
Aurélien Francillon
Aurélien Francillon
中科院分区:
--
文献类型:
--
作者:
Merve Sahin;Marc Relieu;Aurélien Francillon

文献摘要

被引文献

相似文献

最近出现了一种新的对策来反击不想要的电话(例如电话营销、调查或诈骗电话),其包括将电话销售人员与模仿真实的角色的电话机器人(“robocallee”)连接起来。Lenny就是这样一个机器人(一个计算机程序),它播放一组预先录制的语音信息来与垃圾邮件发送者进行交互。虽然不是基于任何复杂的人工智能,但Lenny在保持数十分钟的对话方面令人惊讶地有效。此外,在我们数据集中记录的通话中,只有5%的通话被明确识别为机器人。在本文中,我们试图了解为什么莱尼是如此成功地处理垃圾电话。为此,我们分析了Lenny与各种类型的垃圾邮件发送者的对话记录。在487个公开的电话录音中,我们选择了200个电话,并使用商业服务转录它们。有了这个数据集,我们首先探索了这个聊天机器人捕获的垃圾邮件生态系统,展示了Lenny与垃圾邮件发送者交互的几个统计数据。然后,我们使用会话分析来了解Lenny是如何根据此类垃圾邮件呼叫的顺序上下文进行调整的,从而保持自然的会话流。最后,我们讨论了一系列研究和设计问题,以更好地理解聊天机器人对话并提高其效率。
A new countermeasure recently appeared to fight back against unwanted phone calls (such as, telemarketing, survey or scam calls), which consists in connecting back the telemarketer with a phone bot (“robocallee”) which mimics a real persona. Lenny is such a bot (a computer program) which plays a set of pre-recorded voice messages to interact with the spammers. Although not based on any sophisticated artificial intelligence, Lenny is surprisingly effective in keeping the conversation going for tens of minutes. Moreover, it is clearly recognized as a bot in only 5% of the calls recorded in our dataset. In this paper, we try to understand why Lenny is so successful in dealing with spam calls. To this end, we analyze the recorded conversations of Lenny with various types of spammers. Among 487 publicly available call recordings, we select 200 calls and transcribe them using a commercial service. With this dataset, we first explore the spam ecosystem captured by this chatbot, presenting several statistics on Lenny’s interaction with spammers. Then, we use conversation analysis to understand how Lenny is adjusted with the sequential context of such spam calls, keeping a natural flow of conversation. Finally, we discuss a range of research and design issues to gain a better understanding of chatbot conversations and to improve their efficiency.