Collaborative Research: SaTC: EDU: Fire and ICE: Raising Security Awareness through Experiential Learning Activities for Building Trustworthy Deep Learning-based Applications

协作研究：SaTC：EDU：火灾和 ICE：通过体验式学习活动提高安全意识，构建值得信赖的基于深度学习的应用程序

• 批准号: 2244219
• 负责人: Zhipeng Cai
• 金额: $ 23.53万
• 依托单位: Georgia State University Research Foundation, Inc.
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-07-01 至 2026-06-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2244219&HistoricalAwards=false
• 关键词: Collaborative; Research; SaTC; EDU; Fire

In privacy-sensitive and safety-critical applications, deep learning models are increasingly accepted and utilized. This trend is bound to continue: many open-source frameworks and tools from online code repositories are embedded with deep learning modules. However, many deep learning models contain hidden weaknesses that could be exploited by attacks, posing significant risks to user privacy and safety. It is essential, therefore, to raise security awareness among college students, who are the future data engineering practitioners, and equip them with knowledge and strategies for designing trustworthy, deep learning based applications. This project responds to the urgent need in three critical areas: integrity, confidentiality and equity (ICE). A series of easy-to-implement experiential learning activities concretize learners’ awareness of potential vulnerabilities in deep learning models and enhance their ability to build secure applications of their own. These activities are expressly designed for learners with little prior knowledge, and are streamlined to reduce preparation time and cost for the instructor. The activities’ flexibility maximizes the equitable dissemination of relevant knowledge that is critical to society. The investigators are especially mindful of the needs of minority and socio-economically disadvantaged student populations.A total of twelve learning activity sets address a wide array of issues arising in ICE areas. For data integrity, threats posed by adversarial examples, data poisoning, and backdoor hidden features are tackled. The emphasis on experiential learning allows learners to become acquainted with the process and effects of attacks before learners are equipped with strategies and trained to implement proper defense. To enhance confidentiality, learners first encounter at least two potential sources of privacy leakage, dataset overfitting and abusive querying, and are then taught preventative countermeasures. Both sample biases and algorithmic biases in deep learning models are addressed in the learning activities. Artificial intelligence and deep learning constitute a fast-developing field, and educators must keep pace. The project enriches the supply of educational tools by introducing recent discoveries in the field, including those made by the investigators themselves.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在隐私敏感和安全关键型应用中，深度学习模型越来越多地被接受和使用。这一趋势必将持续下去：许多来自在线代码库的开源框架和工具都嵌入了深度学习模块。然而，许多深度学习模型都包含隐藏的弱点，可能被攻击利用，对用户隐私和安全构成重大风险。因此，必须提高大学生的安全意识，他们是未来的数据工程从业者，并为他们提供设计值得信赖的基于深度学习的应用程序的知识和策略。该项目回应了三个关键领域的迫切需要：诚信、保密和公平（ICE）。一系列易于实施的体验式学习活动具体化了学习者对深度学习模型中潜在漏洞的认识，并增强了他们构建自己安全应用程序的能力。这些活动是专为学习者很少的先验知识，并简化，以减少准备时间和成本的讲师。这些活动的灵活性最大限度地公平传播了对社会至关重要的相关知识。调查人员特别注意少数民族和社会经济弱势学生群体的需求。共有12个学习活动集解决了ICE领域出现的各种问题。对于数据完整性，解决了对抗性示例、数据中毒和后门隐藏功能带来的威胁。对体验式学习的强调使学习者在学习者配备策略并接受培训以实施适当防御之前熟悉攻击的过程和效果。为了提高保密性，学习者首先会遇到至少两个潜在的隐私泄露源，数据集过拟合和滥用查询，然后教预防对策。深度学习模型中的样本偏差和算法偏差都在学习活动中得到解决。人工智能和深度学习是一个快速发展的领域，教育工作者必须跟上步伐。该项目通过介绍该领域的最新发现，包括研究人员自己的发现，丰富了教育工具的供应。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。