SaTC: CORE: Medium: Digital Forensics for Deep Neural Networks
SaTC:核心:媒介:深度神经网络的数字取证
基本信息
- 批准号:2241303
- 负责人:
- 金额:$ 121.6万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2023
- 资助国家:美国
- 起止时间:2023-04-01 至 2027-03-31
- 项目状态:未结题
- 来源:
- 关键词:
项目摘要
The vulnerability of Deep Neural Networks (DNNs) to adversarial attacks remains a major hurdle limiting their use in a wide range of safety-critical applications, such as self-driving cars, medical diagnosis, and financial market analysis. Existing research around adversarial robustness has developed a series of promising defenses, but these are generally broken shortly thereafter by stronger adaptive attacks. This seems unlikely to change, calling for complementary security efforts that increase the cost (in time and computing resources) for successful attacks, reduce the impact of attacks, and identify attackers and vulnerabilities following an attack. This project targets the final goal through developing attack forensics methods to improve the robustness of deep learning systems. The project can alter the playing field between attackers and defenders, by expanding the defense toolset beyond attack prevention to include post-attack analysis.The project will consider three main avenues of attacks on DNNs. The first focuses on analyzing training time poisoning attacks, using clustering and machine unlearning-inspired methods to identify poisoned samples and developing model training methods that trace training provenance to support later forensics. The second focuses on inference time attacks while models are in use, through developing variations of target models that include additional data; the additional data is chosen to maintain accuracy while allowing defenders to make inferences about the models being used to generate attacks. The third focuses on identifying new vulnerabilities arising from neural synthesis models used to generate images, text, and other content, characterizing the space of possible goals attackers might have and methods they might use to poison these models. The project team will also work with industry partners to ground the work and increase the chance of it transferring into real systems, as well as with their department's efforts to increase the number and diversity of people doing research around cybersecurity.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
深度神经网络(dnn)在对抗性攻击面前的脆弱性仍然是限制其在自动驾驶汽车、医疗诊断和金融市场分析等安全关键应用中广泛应用的主要障碍。围绕对抗性健壮性的现有研究已经开发了一系列有希望的防御,但这些防御通常在此后不久就被更强的适应性攻击所打破。这似乎不太可能改变,需要补充安全工作,增加成功攻击的成本(时间和计算资源),减少攻击的影响,并在攻击后识别攻击者和漏洞。该项目的最终目标是通过开发攻击取证方法来提高深度学习系统的鲁棒性。通过将防御工具集从攻击预防扩展到包括攻击后分析,该项目可以改变攻击者和防御者之间的竞争环境。该项目将考虑攻击dnn的三种主要途径。第一个重点是分析训练时间中毒攻击,使用聚类和机器去学习启发的方法来识别中毒样本,并开发模型训练方法来跟踪训练来源,以支持后来的取证。第二个重点是在使用模型时的推理时间攻击,通过开发包含额外数据的目标模型的变体;选择额外的数据是为了保持准确性,同时允许防御者推断用于生成攻击的模型。第三部分侧重于识别用于生成图像、文本和其他内容的神经合成模型产生的新漏洞,描述攻击者可能拥有的目标空间以及他们可能用来毒害这些模型的方法。项目团队还将与行业合作伙伴合作,为这项工作奠定基础,增加其转化为实际系统的机会,并与他们的部门合作,增加网络安全研究人员的数量和多样性。该奖项反映了美国国家科学基金会的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。
项目成果
期刊论文数量(7)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Towards Scalable and Robust Model Versioning
- DOI:10.1109/satml59370.2024.00036
- 发表时间:2024-01
- 期刊:
- 影响因子:0
- 作者:Wenxin Ding;A. Bhagoji;Ben Y. Zhao;Haitao Zheng
- 通讯作者:Wenxin Ding;A. Bhagoji;Ben Y. Zhao;Haitao Zheng
Towards a General Video-based Keystroke Inference Attack
- DOI:
- 发表时间:2023
- 期刊:
- 影响因子:0
- 作者:Zhuolin Yang;Yuxin Chen;Zain Sarwar;Hadleigh Schwartz;Ben Y. Zhao;Haitao Zheng
- 通讯作者:Zhuolin Yang;Yuxin Chen;Zain Sarwar;Hadleigh Schwartz;Ben Y. Zhao;Haitao Zheng
"My face, my rules": Enabling Personalized Protection Against Unacceptable Face Editing
- DOI:10.56553/popets-2023-0080
- 发表时间:2023-07
- 期刊:
- 影响因子:0
- 作者:Zhujun Xiao;Jenna Cryan;Yuanshun Yao;Yi Hong Gordon Cheo;Yuanchao Shu;S. Saroiu;Ben Y. Zhao;Haitao Zheng
- 通讯作者:Zhujun Xiao;Jenna Cryan;Yuanshun Yao;Yi Hong Gordon Cheo;Yuanchao Shu;S. Saroiu;Ben Y. Zhao;Haitao Zheng
Characterizing the Optimal 0-1 Loss for Multi-class Classification with a Test-time Attacker
- DOI:10.48550/arxiv.2302.10722
- 发表时间:2023-02
- 期刊:
- 影响因子:0
- 作者:Sihui Dai;Wen-Luan Ding;A. Bhagoji;Daniel Cullina;Ben Y. Zhao;Haitao Zheng;Prateek Mittal
- 通讯作者:Sihui Dai;Wen-Luan Ding;A. Bhagoji;Daniel Cullina;Ben Y. Zhao;Haitao Zheng;Prateek Mittal
GLAZE: Protecting Artists from Style Mimicry by Text-to-Image Models
- DOI:10.48550/arxiv.2302.04222
- 发表时间:2023-02
- 期刊:
- 影响因子:0
- 作者:Shawn Shan;Jenna Cryan;Emily Wenger;Haitao Zheng;Rana Hanocka;Ben Y. Zhao
- 通讯作者:Shawn Shan;Jenna Cryan;Emily Wenger;Haitao Zheng;Rana Hanocka;Ben Y. Zhao
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Ben Zhao其他文献
Determining of a critical dilution curve for plant nitrogen concentration in winter barley
- DOI:
10.1016/j.fcr.2014.02.016 - 发表时间:
2014-04 - 期刊:
- 影响因子:5.8
- 作者:
Ben Zhao - 通讯作者:
Ben Zhao
Off‐design performance of supercritical carbon dioxide cycle combined with organic Rankine cycle for maritime nuclear propulsion system under different control strategies
不同控制策略下超临界二氧化碳循环与有机朗肯循环相结合的海上核推进系统的超设计性能
- DOI:
10.1002/er.8603 - 发表时间:
2022 - 期刊:
- 影响因子:4.6
- 作者:
Xinyu He;Yadong Du;C. Yang;Chenxing Hu;Hanzhi Zhang;Ben Zhao;Jianbing Gao;Wei Zhao - 通讯作者:
Wei Zhao
Can the allometric relationship between saturated water accumulation and dry mass be used to diagnose the water status of winter wheat?
饱和水积累量与干质量之间的异速关系能否用于诊断冬小麦的水分状况?
- DOI:
- 发表时间:
2024 - 期刊:
- 影响因子:0
- 作者:
Ting;Ben Zhao;Syed Tahir Ata;Gilles Lemaire;Xiaojun Liu;Yongchao Tian;Yan Zhu;W. Cao;Q. Cao - 通讯作者:
Q. Cao
Outcomes of palliative local treatment in metastatic colorectal cancer patients receiving chemotherapy plus bevacizumab
接受化疗加贝伐珠单抗的转移性结直肠癌患者姑息性局部治疗的结果
- DOI:
10.1007/s10330-018-0273-3 - 发表时间:
2018 - 期刊:
- 影响因子:0
- 作者:
Ben Zhao;Lu Wang;Qian;G. Hu;H. Qiu;Mingsheng Zhang;Li Sun;P. Peng;Xianglin Yuan - 通讯作者:
Xianglin Yuan
RTCi versus OSBC teaching method in eight-year medical program: a randomized, controlled educational research
- DOI:
10.1186/s12909-025-07641-6 - 发表时间:
2025-07-18 - 期刊:
- 影响因子:3.200
- 作者:
Lu Wang;Ben Zhao;Xiaohui Wang;Minghao Guo;Lu Wang;Lei Dou;Yinan Sun - 通讯作者:
Yinan Sun
Ben Zhao的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Ben Zhao', 18)}}的其他基金
SaTC: CORE: Medium: Hidden Rules in Neural Networks as Attacks and Adversarial Defenses
SaTC:核心:中:神经网络中作为攻击和对抗性防御的隐藏规则
- 批准号:
1949650 - 财政年份:2020
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
TWC: Small: User Behavior Modeling and Prediction in Anonymous Social Networks
TWC:小:匿名社交网络中的用户行为建模和预测
- 批准号:
1833642 - 财政年份:2017
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
SaTC: CORE: Medium: Collaborative: Defending against Compromise and Manipulation of Mobile Communities
SaTC:核心:媒介:协作:防御移动社区的妥协和操纵
- 批准号:
1705042 - 财政年份:2017
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
SaTC: CORE: Medium: Collaborative: Defending against Compromise and Manipulation of Mobile Communities
SaTC:核心:媒介:协作:防御移动社区的妥协和操纵
- 批准号:
1834523 - 财政年份:2017
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
TWC: Small: User Behavior Modeling and Prediction in Anonymous Social Networks
TWC:小:匿名社交网络中的用户行为建模和预测
- 批准号:
1527939 - 财政年份:2015
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
Student Travel Support for the COSN 2013 Conference
COSN 2013 会议的学生旅行支持
- 批准号:
1343637 - 财政年份:2013
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
III: Small: Analysis and Models of Social Network Structure, Growth and Dynamics
III:小:社交网络结构、增长和动态的分析和模型
- 批准号:
1321083 - 财政年份:2013
- 资助金额:
$ 121.6万 - 项目类别:
Continuing Grant
TWC: Small: Understanding and Defending Against Crowdsourced Online Identities
TWC:小:理解和防御众包在线身份
- 批准号:
1224100 - 财政年份:2012
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
Workshop on Effective Engagement and Collaboration of US CISE Researchers with Their Counterparts in China
美国CISE研究人员与中国同行的有效接触与合作研讨会
- 批准号:
1136500 - 财政年份:2011
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
TC: Small: Towards Automating Privacy Controls for Online Social Networks
TC:小型:实现在线社交网络隐私控制的自动化
- 批准号:
0916307 - 财政年份:2009
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
相似国自然基金
胆固醇羟化酶CH25H非酶活依赖性促进乙型肝炎病毒蛋白Core及Pre-core降解的分子机制研究
- 批准号:82371765
- 批准年份:2023
- 资助金额:50 万元
- 项目类别:面上项目
锕系元素5f-in-core的GTH赝势和基组的开发
- 批准号:22303037
- 批准年份:2023
- 资助金额:30 万元
- 项目类别:青年科学基金项目
基于合成致死策略搭建Core-matched前药共组装体克服肿瘤耐药的机制研究
- 批准号:
- 批准年份:2022
- 资助金额:52 万元
- 项目类别:
鼠伤寒沙门氏菌LPS core经由CD209/SphK1促进树突状细胞迁移加重炎症性肠病的机制研究
- 批准号:
- 批准年份:2022
- 资助金额:30 万元
- 项目类别:青年科学基金项目
基于外泌体精准调控的“核-壳”(core-shell)同步血管化骨组织工程策略的应用与机制探讨
- 批准号:
- 批准年份:2020
- 资助金额:55 万元
- 项目类别:
肌营养不良蛋白聚糖Core M3型甘露糖肽的精确制备及功能探索
- 批准号:92053110
- 批准年份:2020
- 资助金额:70.0 万元
- 项目类别:重大研究计划
Core-1-O型聚糖黏蛋白缺陷诱导胃炎发生并介导慢性胃炎向胃癌转化的分子机制研究
- 批准号:81902805
- 批准年份:2019
- 资助金额:20.5 万元
- 项目类别:青年科学基金项目
原始地球增生晚期的Core-merging大碰撞事件:地核增生、核幔平衡与核幔边界结构的新认识
- 批准号:41973063
- 批准年份:2019
- 资助金额:65.0 万元
- 项目类别:面上项目
CORDEX-CORE区域气候模拟与预估研讨会
- 批准号:41981240365
- 批准年份:2019
- 资助金额:1.5 万元
- 项目类别:国际(地区)合作与交流项目
RBM38通过协助Pol-ε结合、招募core调控HBV复制
- 批准号:31900138
- 批准年份:2019
- 资助金额:24.0 万元
- 项目类别:青年科学基金项目
相似海外基金
Collaborative Research: SaTC: CORE: Medium: Differentially Private SQL with flexible privacy modeling, machine-checked system design, and accuracy optimization
协作研究:SaTC:核心:中:具有灵活隐私建模、机器检查系统设计和准确性优化的差异化私有 SQL
- 批准号:
2317232 - 财政年份:2024
- 资助金额:
$ 121.6万 - 项目类别:
Continuing Grant
Collaborative Research: SaTC: CORE: Medium: Using Intelligent Conversational Agents to Empower Adolescents to be Resilient Against Cybergrooming
合作研究:SaTC:核心:中:使用智能会话代理使青少年能够抵御网络诱骗
- 批准号:
2330940 - 财政年份:2024
- 资助金额:
$ 121.6万 - 项目类别:
Continuing Grant
Collaborative Research: SaTC: CORE: Medium: Differentially Private SQL with flexible privacy modeling, machine-checked system design, and accuracy optimization
协作研究:SaTC:核心:中:具有灵活隐私建模、机器检查系统设计和准确性优化的差异化私有 SQL
- 批准号:
2317233 - 财政年份:2024
- 资助金额:
$ 121.6万 - 项目类别:
Continuing Grant
SaTC: CORE: Medium: Increasing user autonomy and advertiser and platform responsibility in online advertising
SaTC:核心:中:增加在线广告中的用户自主权以及广告商和平台责任
- 批准号:
2318290 - 财政年份:2024
- 资助金额:
$ 121.6万 - 项目类别:
Continuing Grant
SaTC: CORE: Medium: Testing the causal influence of social media on well-being and animosity
SaTC:核心:中:测试社交媒体对幸福感和敌意的因果影响
- 批准号:
2334148 - 财政年份:2024
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
Collaborative Research: SaTC: CORE: Medium: Using Intelligent Conversational Agents to Empower Adolescents to be Resilient Against Cybergrooming
合作研究:SaTC:核心:中:使用智能会话代理使青少年能够抵御网络诱骗
- 批准号:
2330941 - 财政年份:2024
- 资助金额:
$ 121.6万 - 项目类别:
Continuing Grant
SaTC: CORE: Medium: Collaborative: Hardening Off-the-Shelf Software Against Side Channel Attacks
SaTC:核心:媒介:协作:强化现成软件以抵御侧通道攻击
- 批准号:
2425665 - 财政年份:2024
- 资助金额:
$ 121.6万 - 项目类别:
Continuing Grant
Collaborative Research: SaTC: CORE: Medium: Understanding the Impact of Privacy Interventions on the Online Publishing Ecosystem
协作研究:SaTC:核心:媒介:了解隐私干预对在线出版生态系统的影响
- 批准号:
2237329 - 财政年份:2023
- 资助金额:
$ 121.6万 - 项目类别:
Standard Grant
Collaborative Research: SaTC: CORE: Medium: Securing Interactions between Driver and Vehicle Using Batteries
合作研究:SaTC:核心:中:使用电池确保驾驶员和车辆之间的交互安全
- 批准号:
2245224 - 财政年份:2023
- 资助金额:
$ 121.6万 - 项目类别:
Continuing Grant
Collaborative Research: SaTC: CORE: Medium: Understanding and Combatting Impersonation Attacks and Data Leakage in Online Advertising
协作研究:SaTC:核心:媒介:理解和打击在线广告中的冒充攻击和数据泄露
- 批准号:
2247516 - 财政年份:2023
- 资助金额:
$ 121.6万 - 项目类别:
Continuing Grant