PHEMEPlus: Enriching Social Media Rumour Verification with External Evidence
PHEMEPlus: Enriching Social Media Rumour Verification with External Evidence
复制标题
DOI：
10.18653/v1/2022.fever-1.6
复制
发表时间：
2022-07
期刊：
影响因子：
--
通讯作者：
John Dougrez-Lewis;E. Kochkina;M. Arana-Catania;Maria Liakata;Yulan He
中科院分区：
文献类型：
--
作者：
John Dougrez-Lewis;E. Kochkina;M. Arana-Catania;Maria Liakata;Yulan He
社交媒体谣言验证工作利用来自帖子、帖子传播和相关用户的信号。其他工作的目标是根据维基百科的信息或值得信赖的新闻文章来识别和事实核查声明，而不考虑社交媒体背景。然而，将社交媒体的信息与更广泛的网络的外部证据结合起来的工作却很缺乏。为了促进这个方向的研究，我们发布了一个新颖的数据集 PHEMEPlus，它是 PHEME 基准的扩展，其中包含社交媒体对话以及每个谣言的相关外部证据。我们证明了将这些证据纳入改进谣言验证模型的有效性。此外，作为证据收集的一部分，我们评估各种查询制定方式，以确定最有效的方法。
Work on social media rumour verification utilises signals from posts, their propagation and users involved. Other lines of work target identifying and fact-checking claims based on information from Wikipedia, or trustworthy news articles without considering social media context. However works combining the information from social media with external evidence from the wider web are lacking. To facilitate research in this direction, we release a novel dataset, PHEMEPlus, an extension of the PHEME benchmark, which contains social media conversations as well as relevant external evidence for each rumour. We demonstrate the effectiveness of incorporating such evidence in improving rumour verification models. Additionally, as part of the evidence collection, we evaluate various ways of query formulation to identify the most effective method.