CRII:III:Towards Advanced Filtering and Pooling Operations for Graph Neural Networks

CRII:III：走向图神经网络的高级过滤和池化操作

• 批准号: 2406647
• 负责人: Yao Ma
• 金额: $ 17.5万
• 依托单位: Rensselaer Polytechnic Institute
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-10-15 至 2025-06-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2406647&HistoricalAwards=false
• 关键词: CRII; III; Towards; Advanced; Filtering

This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).In recent years, we have witnessed a rapid growth in our ability to generate and gather data from numerous platforms in the online world and various sensors in the physical world. Graphs provide a universal representation for a variety of data including online social networks, knowledge graphs, transportation networks, and chemical compounds. Entities can usually be represented as nodes while their relations can be denoted represented as edges. Many important real-world applications on these data can be treated as computational tasks on graphs. A crucial step to facilitate these tasks is to learn good vector representations either for nodes or graphs. Recently, graph neural networks, which generalize deep learning techniques to graphs, have been widely adopted to learning representations for graphs. Though graph neural networks have advanced numerous real-world applications from various fields, they still suffer from many limitations in terms of efficacy and efficiency. This project aims to address these limitations by conducting theoretical analysis and developing innovative algorithms. This project is specifically motivated by applications to computational social science, computational biology, and fraud detection in e-commerce. Furthermore, this project will involve graduate and undergraduate students in pursuing their theses or honor projects. Discoveries and research findings of this project will be tightly integrated into several current and new courses at the New Jersey Institute of Technology.The technical aims of the project are divided into two tasks corresponding to the two major building components of graph neural networks: graph filtering operations and graph pooling operations. The graph filtering operation aims to refine node representations for all nodes in a graph. On the other hand, the graph pooling operation aims to summarize node representations to obtain a graph representation. The first task aims to investigate graph filtering operations under heterophily—a setting typically poses great challenges for graph filtering operations. In particular, the investigator will conduct theoretical analyses on graph filtering operations to gain deeper insights into their intrinsic mechanism, especially under the scenario of heterophily. Then, based on these understandings, more advanced graph neural networks models will be proposed to handle heterophilous graphs. The second task aims to develop more efficient and effective graph pooling operations. The investigators will explore and develop graph pooling operations based on clustering and down-sampling process. To improve the efficacy and efficiency of the graph pooling operations, the clustering/down-sampling process will be nicely incorporated into the entire learning framework in an end-to-end way.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该奖项全部或部分由2021年美国救援计划法案（公法117-2）资助。近年来，我们见证了我们从在线世界的众多平台和物理世界的各种传感器生成和收集数据的能力的快速增长。图形为各种数据提供了通用表示，包括在线社交网络、知识图、运输网络和化合物。实体通常可以表示为节点，而它们的关系可以表示为边。这些数据上的许多重要的现实应用可以被视为图上的计算任务。促进这些任务的关键一步是学习节点或图的良好矢量表示。最近，将深度学习技术推广到图的图神经网络已被广泛用于学习图的表示。虽然图神经网络已经在各个领域推进了许多现实世界的应用，但它们在功效和效率方面仍然受到许多限制。 该项目旨在通过进行理论分析和开发创新算法来解决这些限制。这个项目是特别动机的应用程序，计算社会科学，计算生物学和电子商务中的欺诈检测。此外，这个项目将涉及研究生和本科生在追求他们的论文或荣誉项目。该项目的发现和研究成果将被紧密地整合到新泽西理工学院的几门现有课程和新课程中。该项目的技术目标分为两个任务，对应于图神经网络的两个主要构建组件：图过滤操作和图池操作。图过滤操作旨在细化图中所有节点的节点表示。另一方面，图池化操作旨在汇总节点表示以获得图表示。第一个任务的目的是研究图过滤操作下heterophily-a设置通常构成了巨大的挑战，图过滤操作。特别是，研究者将对图过滤操作进行理论分析，以更深入地了解其内在机制，特别是在异质性场景下。然后，基于这些理解，将提出更先进的图神经网络模型来处理异形图。第二个任务旨在开发更高效和有效的图池操作。研究人员将探索和开发基于聚类和下采样过程的图池操作。为了提高图池操作的功效和效率，聚类/下采样过程将以端到端的方式很好地融入整个学习框架。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。