Collaborative Research: SaTC: CORE: Small: Understanding how visual features of misinformation influence credibility perceptions

协作研究：SaTC：核心：小：了解错误信息的视觉特征如何影响可信度认知

• 批准号: 2150716
• 负责人: Cuihua Shen
• 金额: $ 28.5万
• 依托单位: University of California-Davis
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-04-01 至 2025-03-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2150716&HistoricalAwards=false
• 关键词: Collaborative; Research; SaTC; CORE; Small

Today’s misinformation posts have increasingly been presented in visual formats, such as images, memes, and videos. Compared to text, visuals are processed faster, remembered better, and are more likely to be shared on social media. As technology makes image and video manipulation accessible to the masses, visual misinformation can be a significant threat to national security, social cohesion, and public health. Yet we need to know more about how specific visual features, such as color and face presence, may influence how people evaluate the credibility of such visual posts. This project offers a comprehensive understanding of how different visual elements may influence users’ perceived credibility of images and videos. The results help platforms and fact-checking agencies to detect visual misinformation, curb its diffusion, identify vulnerable user groups, and develop corrective interventions.Drawing broadly from literature in computer science, advertising, marketing, cognitive science, and communication, and using computer vision analysis, qualitative interviews, large-scale human annotation, and experiments, this research project aims to: 1) identify the specific visual features and mechanisms which may influence people’s credibility perceptions, 2) examine how these visual features interact with non-visual features (source, virality, etc) and user characteristics (partisanship, digital media literacy, etc), and 3) examine how these visual features can be effectively leveraged in misinformation correction efforts. The research team is compiling a large-scale open dataset of visual posts with human annotations. While existing misinformation datasets have largely focused on the veracity of messages, this dataset provides credibility perceptions along with other relevant outcomes such as attention, emotional reactions and aesthetic appeal. In addition, the research team is creating a website with accessible information to educate the general public about misinformation presented in images and videos, so that the public can be aware of their vulnerabilities and be more vigilant towards certain types of visual information.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

今天的错误信息帖子越来越多地以视觉格式呈现，例如图像，模因和视频。与文本相比，视觉效果的处理速度更快，记忆力更好，并且更有可能在社交媒体上分享。随着技术的发展，图像和视频的操纵可以为大众所用，视觉错误信息可能对国家安全，社会凝聚力和公共健康构成重大威胁。然而，我们需要更多地了解特定的视觉特征（例如颜色和面部存在）如何影响人们如何评估此类视觉帖子的可信度。这个项目提供了一个全面的理解，不同的视觉元素如何影响用户对图像和视频的感知可信度。该研究结果有助于平台和事实核查机构检测视觉错误信息，遏制其传播，识别弱势用户群体，并制定纠正干预措施。该研究项目广泛借鉴计算机科学，广告，营销，认知科学和传播学的文献，并使用计算机视觉分析，定性访谈，大规模人类注释和实验，旨在：1）识别可能影响人们可信度感知的特定视觉特征和机制，2）检查这些视觉特征如何与非视觉特征（来源，病毒式传播等）和用户特征（党派，数字媒体素养等）相互作用，以及3）检查这些视觉特征如何有效地利用错误信息纠正工作。该研究团队正在编制一个大规模的开放数据集，其中包含带有人类注释的视觉帖子。虽然现有的错误信息数据集主要集中在消息的真实性上，但该数据集提供了可信度感知沿着以及其他相关结果，如注意力，情绪反应和美学吸引力。此外，研究小组正在创建一个网站，提供可访问的信息，以教育公众有关图像和视频中的错误信息，使公众能够意识到他们的弱点，并对某些类型的视觉信息更加警惕。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查进行评估，被认为值得支持的搜索.

项目成果

An Agenda for Studying Credibility Perceptions of Visual Misinformation

研究视觉错误信息可信度的议程

• DOI: 10.1080/10584609.2023.2175398
• 发表时间: 2023
• 期刊: Political Communication
• 影响因子: 7.5
• 作者: Peng, Yilang;Lu, Yingdan;Shen, Cuihua
• 通讯作者: Shen, Cuihua

Convergence or divergence? A cross-platform analysis of climate change visual content categories, features, and social media engagement on Twitter and Instagram

趋同还是发散？

• DOI: 10.1016/j.pubrev.2024.102454
• 发表时间: 2024
• 期刊: Public Relations Review
• 影响因子: 4.2
• 作者: Qian, Sijia;Lu, Yingdan;Peng, Yilang;Shen, Cuihua;Xu, Huacen
• 通讯作者: Xu, Huacen