Collaborative Research: ATD: Robust, Accurate and Efficient Graph-Structured RNN for Spatio-Temporal Forecasting and Anomaly Detection

合作研究：ATD：用于时空预测和异常检测的鲁棒、准确和高效的图结构 RNN

• 批准号: 2110145
• 负责人: Bao Wang
• 金额: $ 12万
• 依托单位: University of Utah
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-01-15 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2110145&HistoricalAwards=false
• 关键词: Collaborative; Research; ATD; Robust; Accurate

The project aims to develop robust, efficient, and transferrable deep learning algorithms for prediction and anomaly detection in human spatio-temporal dynamics. This will be a fundamental step in providing reliable and speedy decision support for mitigating infectious diseases and countering threats in a time varying and spatially complex environment. The project shall advance recent computational tools (deep neural networks) in adversarial conditions and on resource limited (low cost, low energy) platform, thereby contribute to information technology in adversarial learning, mobile computing and effective decision making. A broad range of applications include threat detection and prediction for traffic and public transportation networks, security and privacy critical data analysis and prediction, threat detection and error correction for hydraulic, electrical and nuclear power systems. The approaches to be used involve novel techniques in high dimensional non-smooth non-convex optimization and graph representation. Specifically, the project shall study (1) multi-scale graph-structured recurrent neural networks for spatio-temporal data modeling, prediction and anomaly detection; (2) adversarially robust, accurate, and transferable deep learning algorithms based on advection-diffusion equations; (3) efficient quantization algorithms under adversarial conditions to reduce the latency of deep networks. The projects shall train a diverse body of graduate and undergraduate students at the Irvine and Los Angeles campuses of University of California through collaborative education and research activities in applied mathematics, computer science, data science and social science.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目旨在开发鲁棒、高效、可转移的深度学习算法，用于人类时空动态的预测和异常检测。这将是在一个时变和空间复杂的环境中为减轻传染病和应对威胁提供可靠和迅速决策支持的一个基本步骤。该项目将在对抗条件和资源有限（低成本、低能耗）平台上推进最新计算工具（深度神经网络），从而为对抗学习、移动计算和有效决策中的信息技术做出贡献。广泛的应用包括交通和公共交通网络的威胁检测和预测，安全和隐私关键数据分析和预测，液压，电气和核电系统的威胁检测和纠错。所使用的方法涉及高维非光滑非凸优化和图表示的新技术。具体而言，项目将研究(1)用于时空数据建模、预测和异常检测的多尺度图结构递归神经网络；(2)基于平流扩散方程的对抗鲁棒、精确和可转移的深度学习算法；(3)对抗条件下有效的量化算法，降低深度网络的延迟。这些项目将通过应用数学、计算机科学、数据科学和社会科学方面的合作教育和研究活动，在加州大学欧文分校和洛杉矶分校培养多样化的研究生和本科生。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Implicit Graph Neural Networks: A Monotone Operator Viewpoint

• 发表时间: 2023
• 作者: Justin Baker;Qingsong Wang;C. Hauck;Bao Wang

A deterministic gradient-based approach to avoid saddle points

一种避免鞍点的基于确定性梯度的方法

• DOI: 10.1017/s0956792522000316
• 发表时间: 2022
• 期刊: European Journal of Applied Mathematics
• 影响因子: 1.9
• 作者: Kreusser, L. M.;Osher, S. J.;Wang, B.
• 通讯作者: Wang, B.

Efficient and Reliable Overlay Networks for Decentralized Federated Learning

• DOI: 10.1137/21m1465081
• 发表时间: 2021-12
• 期刊: SIAM J. Appl. Math.
• 作者: Yifan Hua;Kevin Miller;A. Bertozzi;Chen Qian;Bao Wang

How does momentum benefit deep neural networks architecture design? A few case studies

• DOI: 10.1007/s40687-022-00352-0
• 发表时间: 2021-10
• 期刊: Research in the Mathematical Sciences
• 影响因子: 1.2
• 作者: Bao Wang;Hedi Xia;T. Nguyen;S. Osher