Collaborative Research: Robust Deep Learning in Real Physical Space: Generalization, Scalability, and Credibility

深度神经网络对微小和不可感知的扰动的脆弱性是当今机器学习的一个主要挑战。对于自动驾驶汽车、安全和医疗诊断等各种应用来说，这一弱点严重限制了机器学习系统的大规模部署。现有的理论研究虽然基于先进的统计分析奠定了良好的基础，但需要各种理想化的假设，这些假设很难在真实的物理环境中得到验证。因此，理解深度学习算法的鲁棒性及其与真实的物理环境的交互是更好地理解可解释性、泛化性和可信度的关键一步。该项目旨在通过开发新的理论和计算机视觉系统来缩小差距，这些理论和系统可以实际验证。研究成果将创造新技术，可转化为更安全可靠的商业产品，从而加强美国的全球竞争力;新的值得信赖的人工智能系统，可用于监视和防御产品，以改善美国的国家安全。通过开发一个完整的培训管道，从K-12推广到本科研究，研究生指导，行业合作伙伴关系，在线学习模块，该项目的主要目标是：促进科学、技术、工程学和课程开发;通过利用基础研究概念的可及性和吸引力，扩大对科学、技术、工程学和数学的参与，以小学到研究生院的女性参与者为目标开展教育推广活动;促进统计学、理论计算机科学和图像处理等学科之间的思想交流。真实的物理空间中的鲁棒机器学习需要对深度神经网络和神经网络运行的环境进行协同建模。研究工作集中在一个特定的领域，但不与其他领域的互动不太可能解决问题。普渡大学-加州大学圣地亚哥分校团队所拥有的电气工程、统计学和计算机科学技能的结合为解决这一问题提供了独特的机会。该团队将采取的技术方法是通过纳入环境因素来重新制定鲁棒对抗学习问题。四个具体的研究目标将被追求：（1）参数化的物理环境，通过一个层次的确定性和生成的方法，使所有可能的扭曲可以被约束。(2)分析了神经网络在环境因素影响下的泛化能力，并通过对鲁棒性和不确定性量化的研究，分析了系统的可信性。(3)开发计算效率高的算法来寻求一个建议的最小最大优化的平衡点。(4)建立一个计算摄影实验平台来实现这些概念并验证理论结果。在教育方面，该项目为K-12提供了一系列外展活动，以提高他们对STEM的兴趣，并为本科生提供研究机会。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The vulnerability of deep neural networks to small and imperceptible perturbations is a major challenge in machine learning today. For a variety of applications such as autonomous vehicles, security, and medical diagnosis, this weakness has severely limited the deployment of machine learning systems at scale. Existing theoretical studies, while laying a good foundation based on advanced statistical analyses, require various idealistic assumptions that are difficult to be validated in real physical environments. Understanding the robustness of deep learning algorithms and its interactions with the real physical environment is therefore a critical step towards a better understanding of explainability, generalization, and trustworthiness. This project aims to close the gap by developing new theories and computer vision systems that can be realistically validated. The outcomes of the research will create new technologies that can be translated into more secure and reliable commercial products, hence strengthening the global competitiveness of the United States; new trustworthy AI systems that can be deployed for surveillance and defense products to improve the national security of the United States; expand the next-generation workforce capacity by developing a complete training pipeline from K-12 outreach to undergraduate research, graduate mentoring, industry partnership, online learning modules, and curriculum development; broaden participation in STEM by leveraging the accessibility and intrigue of the foundational research concepts to conduct educational outreach that targets female participants from elementary up through graduate school; and promote the exchanges of ideas across disciplines in statistics, theoretical computer science, and image processing. Robust machine learning in real physical space requires co-modeling the deep neural networks and the environment in which the neural networks are operating. Research efforts focusing on one specific domain but not interacting with the other domain will unlikely solve the problem. The combination of skills in electrical engineering, statistics, and computer science possessed by the Purdue-UCSD team offers a unique opportunity to address the problem. The technical approach the team will take is to reformulate the robust adversarial learning problem by incorporating the environmental factors. Four specific research objectives will be pursued: (1) Parametrizing the physical environment via a hierarchy of deterministic and generative approaches, so that the set of all possible distortions can be constrained. (2) Analyzing the generalization bounds of neural networks in the presence of the environmental factors and analyzing the credibility of such a system by studying the robustness and uncertainty quantification. (3) Developing computationally efficient algorithms to seek the equilibrium points of a proposed minimax optimization. (4) Building a computational photography testbed to implement the concepts and validate the theoretical results. On the educational front, the project provides a suite of outreach activities to K-12 to improve their interest in STEM, and research opportunities to undergraduates.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.