A Structured Response to Misinformation: Defining and Annotating Credibility Indicators in News Articles
A Structured Response to Misinformation: Defining and Annotating Credibility Indicators in News Articles
复制标题
对错误信息的结构化回应：定义和注释新闻文章中的可信度指标
DOI：
--
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
A. Mina
中科院分区：
文献类型：
--
作者：
Amy X. Zhang;Aditya Ranganathan;S. E. Metz;S. Appling;Connie Moon Sehat;Norman Gilmore;Nick B. Adams;Emmanuel Vincent;Jennifer Lee;Martin Robbins;Ed M. Bice;Sandro Hawke;David R Karger;A. Mina
网络新闻中错误信息的泛滥及其平台的放大越来越引起人们的关注，导致人们做出了大量努力来改进对错误信息的检测和响应。考虑到方法的多样性，对表示可信内容的指标达成集体协议可以促进跨倡议之间更好的协作和数据共享。在本文中，我们提出了由不同专家联盟定义的一组初始的文章可信度指标。这些指标既来自文章的文本，也来自外部来源或文章元数据。作为概念验证，我们提供了一个由 40 篇可信度不同的文章组成的数据集，由 6 位训练有素的注释者使用专门平台用我们的指标进行注释。我们讨论了未来的步骤，包括扩大注释、扩大指标集，并考虑平台和公众对它们的使用，以制定内容可信度的可互操作标准。
The proliferation of misinformation in online news and its amplification by platforms are a growing concern, leading to numerous efforts to improve the detection of and response to misinformation. Given the variety of approaches, collective agreement on the indicators that signify credible content could allow for greater collaboration and data-sharing across initiatives. In this paper, we present an initial set of indicators for article credibility defined by a diverse coalition of experts. These indicators originate from both within an article's text as well as from external sources or article metadata. As a proof-of-concept, we present a dataset of 40 articles of varying credibility annotated with our indicators by 6 trained annotators using specialized platforms. We discuss future steps including expanding annotation, broadening the set of indicators, and considering their use by platforms and the public, towards the development of interoperable standards for content credibility.