Collaborative Research: Robust Deep Learning in Real Physical Space: Generalization, Scalability, and Credibility

深度神经网络对微小和不可察觉的扰动的脆弱性是当今机器学习的主要挑战。对于自动驾驶汽车、安全和医疗诊断等各种应用，这一弱点严重限制了机器学习系统的大规模部署。现有的理论研究虽然基于先进的统计分析奠定了良好的基础，但需要各种理想化的假设，而这些假设很难在真实的物理环境中得到验证。因此，了解深度学习算法的健壮性及其与真实物理环境的相互作用是更好地理解可解释性、泛化和可信性的关键一步。该项目旨在通过开发可实际验证的新理论和计算机视觉系统来缩小差距。研究成果将创造可转化为更安全可靠的商业产品的新技术，从而增强美国的全球竞争力；可用于监视和国防产品的新的值得信赖的人工智能系统，以改善美国的国家安全；通过开发从K-12扩展到本科生研究、研究生指导、行业合作、在线学习模块和课程开发的完整培训管道，扩大下一代劳动力能力；通过利用基础研究概念的可获得性和趣味性，开展针对从小学到研究生院的女性参与者的教育推广，扩大对STEM的参与；并促进统计学、理论计算机科学和图像处理领域的跨学科思想交流。在真实物理空间中进行稳健的机器学习需要对深层神经网络和神经网络运行的环境进行联合建模。专注于一个特定领域而不与另一个领域互动的研究努力不太可能解决问题。普渡大学-加州大学SD分校的团队结合了电气工程、统计学和计算机科学的技能，为解决这个问题提供了一个独特的机会。该团队将采取的技术方法是通过纳入环境因素来重新制定稳健的对抗性学习问题。将追求四个具体的研究目标：(1)通过确定性和生成性方法的层级将物理环境参数化为参数，以便可以限制所有可能的扭曲。(2)分析了神经网络在环境因素影响下的泛化界，并通过对系统的鲁棒性和不确定性量化的研究，分析了神经网络系统的可信度。(3)开发计算效率高的算法来寻找所提出的极小极大优化的平衡点。(4)搭建了计算摄影实验台，实现了概念，验证了理论结果。在教育方面，该项目为K-12提供了一系列外展活动，以提高他们对STEM的兴趣，并为本科生提供研究机会。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

The vulnerability of deep neural networks to small and imperceptible perturbations is a major challenge in machine learning today. For a variety of applications such as autonomous vehicles, security, and medical diagnosis, this weakness has severely limited the deployment of machine learning systems at scale. Existing theoretical studies, while laying a good foundation based on advanced statistical analyses, require various idealistic assumptions that are difficult to be validated in real physical environments. Understanding the robustness of deep learning algorithms and its interactions with the real physical environment is therefore a critical step towards a better understanding of explainability, generalization, and trustworthiness. This project aims to close the gap by developing new theories and computer vision systems that can be realistically validated. The outcomes of the research will create new technologies that can be translated into more secure and reliable commercial products, hence strengthening the global competitiveness of the United States; new trustworthy AI systems that can be deployed for surveillance and defense products to improve the national security of the United States; expand the next-generation workforce capacity by developing a complete training pipeline from K-12 outreach to undergraduate research, graduate mentoring, industry partnership, online learning modules, and curriculum development; broaden participation in STEM by leveraging the accessibility and intrigue of the foundational research concepts to conduct educational outreach that targets female participants from elementary up through graduate school; and promote the exchanges of ideas across disciplines in statistics, theoretical computer science, and image processing. Robust machine learning in real physical space requires co-modeling the deep neural networks and the environment in which the neural networks are operating. Research efforts focusing on one specific domain but not interacting with the other domain will unlikely solve the problem. The combination of skills in electrical engineering, statistics, and computer science possessed by the Purdue-UCSD team offers a unique opportunity to address the problem. The technical approach the team will take is to reformulate the robust adversarial learning problem by incorporating the environmental factors. Four specific research objectives will be pursued: (1) Parametrizing the physical environment via a hierarchy of deterministic and generative approaches, so that the set of all possible distortions can be constrained. (2) Analyzing the generalization bounds of neural networks in the presence of the environmental factors and analyzing the credibility of such a system by studying the robustness and uncertainty quantification. (3) Developing computationally efficient algorithms to seek the equilibrium points of a proposed minimax optimization. (4) Building a computational photography testbed to implement the concepts and validate the theoretical results. On the educational front, the project provides a suite of outreach activities to K-12 to improve their interest in STEM, and research opportunities to undergraduates.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.