SaTC: CORE: Small: Collaborative: Understanding and Mitigating Adversarial Manipulation of Content Curation Algorithms
SaTC:核心:小型:协作:理解和减轻内容管理算法的对抗性操纵
基本信息
- 批准号:1813697
- 负责人:
- 金额:$ 25万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2018
- 资助国家:美国
- 起止时间:2018-07-15 至 2019-07-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Online social networks (OSNs) have fundamentally transformed how billions of people use the Internet. These users are increasingly discovering books, music bands, TV shows, movies, news articles, products, and other content through posts from trusted users that they follow. All major OSNs have deployed content curation algorithms that are designed to increase interaction and act as the "gatekeepers" of what users see. While this curation and filtering is useful and necessary given the amount of content available, it has also exposed people and platforms to manipulation attacks whereby bad actors attempt to promote content people would otherwise prefer not to see. This has driven the creation of an underground ecosystem that provides services and techniques tailored towards subverting OSNs' content curation algorithms for economic and ideological gains. This project will conduct open research to improve our understanding of current algorithmic curation attackers. The team will devise content curation algorithms and defenses which are hardened against manipulation and that can be adopted by these OSN platforms, providing a systematic approach to improving design and practice in an area of critical national importance. Technology transfer from this project will protect the integrity of social media discourse from adversarial manipulation. This project will train students with expertise in security and machine learning, areas of broad national need, and produce educational materials to engage both high school students and the public in these critical questions. The team will holistically explore the economic, social, and technical perspectives of machine learning-based content curation algorithms' weaknesses. The research comprises three main activities: 1) understand how OSNs are currently being successfully manipulated at large scales, 2) investigate the defenses OSNs have in place, and 3) design more resilient defenses. The team will build the first-ever taxonomy of manipulation services and techniques that are actively used to manipulate curation algorithms. Another thrust of the project is to create a framework for the external evaluation of deployed manipulation defenses based on the collection of both public data from the OSN's platform and external data to compare it against. The team will then develop robust and scalable algorithms to detect OSN manipulation within the collected data. Finally, the team will use the insights from the taxonomy of effective manipulation techniques and the exploration of the limitation of current defenses to design fundamentally resilient content curation algorithms. The project will explore both new curation algorithms and more effective mitigation techniques for existing algorithms. The project's findings will deepen our understanding of social network manipulation and adversarial learning and produce reliable approaches to algorithmic content curation.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
在线社交网络(OSN)从根本上改变了数十亿人使用互联网的方式。这些用户越来越多地通过他们关注的可信用户的帖子发现书籍、乐队、电视节目、电影、新闻文章、产品和其他内容。所有主要的OSN都部署了内容策展算法,旨在增加互动,并充当用户所见内容的“守门人”。虽然考虑到可用内容的数量,这种管理和过滤是有用和必要的,但它也使人们和平台暴露在操纵攻击中,不良行为者试图推广人们不愿看到的内容。这推动了一个地下生态系统的创建,该生态系统提供针对颠覆OSN的内容策展算法以获得经济和意识形态收益的服务和技术。该项目将进行开放式研究,以提高我们对当前算法策展攻击者的理解。该团队将设计内容策展算法和防御措施,这些算法和防御措施可以被这些OSN平台采用,从而提供一种系统的方法来改进具有关键国家重要性的领域的设计和实践。该项目的技术转让将保护社交媒体话语的完整性,使其免受敌对操纵。该项目将培养学生在安全和机器学习方面的专业知识,这些领域具有广泛的国家需求,并制作教育材料,让高中生和公众参与这些关键问题。该团队将全面探索基于机器学习的内容策展算法弱点的经济,社会和技术角度。该研究包括三个主要活动:1)了解OSN目前如何被大规模成功操纵,2)调查OSN的防御措施,3)设计更具弹性的防御措施。该团队将建立有史以来第一个操纵服务和技术的分类,这些服务和技术被积极用于操纵策展算法。该项目的另一个重点是创建一个框架,用于对部署的操纵防御进行外部评估,该框架基于从OSN平台收集的公共数据和外部数据进行比较。然后,该团队将开发强大且可扩展的算法,以检测所收集数据中的OSN操作。最后,该团队将利用有效操作技术分类的见解和对当前防御限制的探索,设计具有根本弹性的内容策展算法。该项目将探索新的策展算法和现有算法的更有效的缓解技术。该项目的发现将加深我们对社交网络操纵和对抗性学习的理解,并为算法内容策展提供可靠的方法。该奖项反映了NSF的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Rachel Greenstadt其他文献
Challenges in Restructuring Community-based Moderation
重组基于社区的审核面临的挑战
- DOI:
10.48550/arxiv.2402.17880 - 发表时间:
2024 - 期刊:
- 影响因子:0
- 作者:
Chau Tran;Kejsi Take;Kaylea Champion;Benjamin Mako Hill;Rachel Greenstadt - 通讯作者:
Rachel Greenstadt
From User Insights to Actionable Metrics: A User-Focused Evaluation of Privacy-Preserving Browser Extensions
从用户洞察到可操作的指标:以用户为中心的隐私保护浏览器扩展评估
- DOI:
- 发表时间:
2024 - 期刊:
- 影响因子:0
- 作者:
Ritik Roongta;Rachel Greenstadt - 通讯作者:
Rachel Greenstadt
Stoking the Flames: Understanding Escalation in an Online Harassment Community
煽风点火:了解在线骚扰社区的升级
- DOI:
10.1145/3641015 - 发表时间:
2024 - 期刊:
- 影响因子:0
- 作者:
Kejsi Take;Victoria Zhong;Chris Geeng;Emmi Bevensee;Damon McCoy;Rachel Greenstadt - 通讯作者:
Rachel Greenstadt
Feature Vector Difference based Authorship Verification for Open-World Settings
开放世界设置中基于特征向量差异的作者身份验证
- DOI:
- 发表时间:
2021 - 期刊:
- 影响因子:0
- 作者:
Janith Weerasinghe;Rhia Singh;Rachel Greenstadt - 通讯作者:
Rachel Greenstadt
Rachel Greenstadt的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Rachel Greenstadt', 18)}}的其他基金
NSF-NSERC: SaTC: CORE: Small: Managing Risks of AI-generated Code in the Software Supply Chain
NSF-NSERC:SaTC:核心:小型:管理软件供应链中人工智能生成代码的风险
- 批准号:
2341206 - 财政年份:2024
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
Collaborative Research: Conference: 2023 Workshop for Aspiring PIs in Secure and Trusted Cyberspace
协作研究:会议:2023 年安全可信网络空间中有抱负的 PI 研讨会
- 批准号:
2247405 - 财政年份:2023
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
Collaborative Research: SaTC: CORE: Medium: Threat Intelligence for Targets of Coordinated Harassment
协作研究:SaTC:核心:中:协调骚扰目标的威胁情报
- 批准号:
2016061 - 财政年份:2020
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
SaTC: CORE: Medium: Collaborative: Measuring the Value of Anonymous Online Participation
SaTC:核心:媒介:协作:衡量匿名在线参与的价值
- 批准号:
2031951 - 财政年份:2019
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
SaTC: CORE: Small: Collaborative: Understanding and Mitigating Adversarial Manipulation of Content Curation Algorithms
SaTC:核心:小型:协作:理解和减轻内容管理算法的对抗性操纵
- 批准号:
1931005 - 财政年份:2019
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
SaTC: CORE: Medium: Collaborative: Measuring the Value of Anonymous Online Participation
SaTC:核心:媒介:协作:衡量匿名在线参与的价值
- 批准号:
1703736 - 财政年份:2017
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
Student Travel Support: Privacy Enhancing Technology Symposium (PETS) 2015
学生旅行支持:隐私增强技术研讨会 (PETS) 2015
- 批准号:
1523108 - 财政年份:2015
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
CAREER: Privacy Analytics for Users in a Big Data World
职业:大数据世界中用户的隐私分析
- 批准号:
1253418 - 财政年份:2013
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
EAGER: Investigating Diversity in Online Community Filtering
EAGER:调查在线社区过滤的多样性
- 批准号:
1048515 - 财政年份:2010
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
相似国自然基金
胆固醇羟化酶CH25H非酶活依赖性促进乙型肝炎病毒蛋白Core及Pre-core降解的分子机制研究
- 批准号:82371765
- 批准年份:2023
- 资助金额:50 万元
- 项目类别:面上项目
锕系元素5f-in-core的GTH赝势和基组的开发
- 批准号:22303037
- 批准年份:2023
- 资助金额:30 万元
- 项目类别:青年科学基金项目
基于合成致死策略搭建Core-matched前药共组装体克服肿瘤耐药的机制研究
- 批准号:
- 批准年份:2022
- 资助金额:52 万元
- 项目类别:
鼠伤寒沙门氏菌LPS core经由CD209/SphK1促进树突状细胞迁移加重炎症性肠病的机制研究
- 批准号:
- 批准年份:2022
- 资助金额:30 万元
- 项目类别:青年科学基金项目
基于外泌体精准调控的“核-壳”(core-shell)同步血管化骨组织工程策略的应用与机制探讨
- 批准号:
- 批准年份:2020
- 资助金额:55 万元
- 项目类别:
肌营养不良蛋白聚糖Core M3型甘露糖肽的精确制备及功能探索
- 批准号:92053110
- 批准年份:2020
- 资助金额:70.0 万元
- 项目类别:重大研究计划
Core-1-O型聚糖黏蛋白缺陷诱导胃炎发生并介导慢性胃炎向胃癌转化的分子机制研究
- 批准号:81902805
- 批准年份:2019
- 资助金额:20.5 万元
- 项目类别:青年科学基金项目
原始地球增生晚期的Core-merging大碰撞事件:地核增生、核幔平衡与核幔边界结构的新认识
- 批准号:41973063
- 批准年份:2019
- 资助金额:65.0 万元
- 项目类别:面上项目
RBM38通过协助Pol-ε结合、招募core调控HBV复制
- 批准号:31900138
- 批准年份:2019
- 资助金额:24.0 万元
- 项目类别:青年科学基金项目
CORDEX-CORE区域气候模拟与预估研讨会
- 批准号:41981240365
- 批准年份:2019
- 资助金额:1.5 万元
- 项目类别:国际(地区)合作与交流项目
相似海外基金
SaTC: CORE: Small: An evaluation framework and methodology to streamline Hardware Performance Counters as the next-generation malware detection system
SaTC:核心:小型:简化硬件性能计数器作为下一代恶意软件检测系统的评估框架和方法
- 批准号:
2327427 - 财政年份:2024
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
Collaborative Research: NSF-BSF: SaTC: CORE: Small: Detecting malware with machine learning models efficiently and reliably
协作研究:NSF-BSF:SaTC:核心:小型:利用机器学习模型高效可靠地检测恶意软件
- 批准号:
2338301 - 财政年份:2024
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
Collaborative Research: NSF-BSF: SaTC: CORE: Small: Detecting malware with machine learning models efficiently and reliably
协作研究:NSF-BSF:SaTC:核心:小型:利用机器学习模型高效可靠地检测恶意软件
- 批准号:
2338302 - 财政年份:2024
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
SaTC: CORE: Small: NSF-DST: Understanding Network Structure and Communication for Supporting Information Authenticity
SaTC:核心:小型:NSF-DST:了解支持信息真实性的网络结构和通信
- 批准号:
2343387 - 财政年份:2024
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
NSF-NSERC: SaTC: CORE: Small: Managing Risks of AI-generated Code in the Software Supply Chain
NSF-NSERC:SaTC:核心:小型:管理软件供应链中人工智能生成代码的风险
- 批准号:
2341206 - 财政年份:2024
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
Collaborative Research: SaTC: CORE: Small: Towards Secure and Trustworthy Tree Models
协作研究:SaTC:核心:小型:迈向安全可信的树模型
- 批准号:
2413046 - 财政年份:2024
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
SaTC: CORE: Small: Study, Detection and Containment of Influence Campaigns
SaTC:核心:小型:影响力活动的研究、检测和遏制
- 批准号:
2321649 - 财政年份:2023
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
SaTC: CORE: Small: Socio-Technical Approaches for Securing Cyber-Physical Systems from False Claim Attacks
SaTC:核心:小型:保护网络物理系统免受虚假声明攻击的社会技术方法
- 批准号:
2310470 - 财政年份:2023
- 资助金额:
$ 25万 - 项目类别:
Standard Grant
Collaborative Research: SaTC: CORE: Small: Investigation of Naming Space Hijacking Threat and Its Defense
协作研究:SaTC:核心:小型:命名空间劫持威胁及其防御的调查
- 批准号:
2317830 - 财政年份:2023
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant
Collaborative Research: SaTC: CORE: Small: Towards a Privacy-Preserving Framework for Research on Private, Encrypted Social Networks
协作研究:SaTC:核心:小型:针对私有加密社交网络研究的隐私保护框架
- 批准号:
2318843 - 财政年份:2023
- 资助金额:
$ 25万 - 项目类别:
Continuing Grant