Collaborative Research: SHF: Small: LEGAS: Learning Evolving Graphs At Scale

协作研究：SHF：小型：LEGAS：大规模学习演化图

• 批准号: 2331302
• 负责人: Binghui Wang
• 金额: $ 29.13万
• 依托单位: Illinois Institute of Technology
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-01-01 至 2026-12-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2331302&HistoricalAwards=false
• 关键词: Collaborative; Research; SHF; Small; LEGAS

Graph Neural Networks (GNNs) are an emerging class of deep learning models on graphs, with many successful applications, such as, recommendation systems, drug discovery, social network analysis, and code vulnerability detection. However, the computation for GNNs faces a low efficiency problem as they involve complex matrix and vector operations. Further, when applied to graphs that are dynamically changing, the efficiency issue exacerbates. This project pioneers the effort of developing efficient GNN algorithms and computation systems for both static and dynamic graphs that can take advantage of world-class Graphics Processing Unit (GPU) computing facilities. This project contributes to the growing national need for professionals in machine learning and computation systems. This project produces a high-performance software library that serves as a foundational tool for fellow science and engineering practitioners from academia, national laboratories, and industry. Additionally, educational efforts are made to integrate the research findings into graduate and undergraduate curriculum development. Outreach and educational activities are conducted to promote the participation of K-12, undergraduate, female, and underrepresented minorities. The overarching goal of this project is to design an efficient GNN framework via algorithm and system co-design for both static and dynamic graphs. Towards that, this project designs three synergistic research thrusts. Specifically, Thrust 1 improves the efficiency from the algorithm level by designing novel GNN algorithms that are efficient, allow the entire graph to be retained, and offer convergence guarantees. Thrust 2 advances the system performance by designing efficient computation techniques on GPUs with efficient workload scheduling and reduced synchronization overhead. In addition, Thrust 3 incorporates the techniques in Thrusts 1 and 2, and designs novel strategies to address the unique algorithm and computation challenges in dynamic graphs.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

图神经网络（GNN）是一类新兴的基于图的深度学习模型，具有许多成功的应用，例如推荐系统，药物发现，社交网络分析和代码漏洞检测。然而，GNN的计算面临着低效率的问题，因为它们涉及复杂的矩阵和向量运算。此外，当应用于动态变化的图形时，效率问题会加剧。该项目开创了为静态和动态图形开发高效GNN算法和计算系统的工作，这些算法和计算系统可以利用世界一流的图形处理单元（GPU）计算设施。该项目有助于国家对机器学习和计算系统专业人员日益增长的需求。该项目产生了一个高性能的软件库，作为来自学术界，国家实验室和工业界的科学和工程从业人员的基础工具。此外，教育方面的努力，将研究成果纳入研究生和本科生课程开发。开展外联和教育活动，以促进K-12，本科生，女性和代表性不足的少数民族的参与。该项目的总体目标是通过静态和动态图的算法和系统协同设计来设计一个高效的GNN框架。为此，本项目设计了三个协同研究重点。具体来说，Thrust 1通过设计新的GNN算法来提高算法级别的效率，这些算法是有效的，允许保留整个图，并提供收敛保证。Thrust 2通过在GPU上设计高效的计算技术来提高系统性能，这些技术具有高效的工作负载调度和减少的同步开销。此外，Thrust 3融合了Thrust 1和2中的技术，并设计了新颖的策略来解决动态图中独特的算法和计算挑战。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。