课题基金 / 基金详情

SHF:Small:Software and Hardware Optimizations for Learning over Graphs

SHF:Small:Software and Hardware Optimizations for Learning over Graphs
SHF:Small:图学习的软件和硬件优化
批准号:
2008398
负责人:
Mehrdad Mahdavi
金额:
$50.0万
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2020
资助国家:
美国
项目状态:
已结题
起止时间:
2020-10-01 至 2024-09-30

项目摘要

项目成果

Mehrdad Mahdavi的其他基金

相似基金

相关文献

中文摘要
翻译
许多新兴的高性能应用程序来自国家重要的各个领域(例如,天体物理学、计算化学、药物发现和核物理学)采用大型图形结构(具有数百万个节点和连接它们的边)来表示它们的数据,并对它们执行不同类型的分析,目的是从这些海量数据中理解和提取有用的信息。 虽然这种基于图的分析正在迅速成为高性能计算的基础部分,但现有的图分析方法不能随着硬件资源的增加而扩展,大多采用传统的机器学习/图分析策略,并且没有充分利用新兴的异构计算和存储元素。因此,从大规模基于图形的数据中获得洞察力的时间显着增加,从而减缓了科学发现。受此观察的启发,这个NSF资助的项目从整体的角度探索了图神经网络(GNN),这是一种直接在图结构上运行的神经网络,作为优化各种高性能应用程序的主要工具,这些应用程序受益于机器学习和数据分析。该项目的最终目标是在各种应用领域中从现有的机器学习机制顺利有效地过渡到GNN。通过促进更高效、更具成本效益地使用定制集群、超级计算机和云系统提供的硬件资源,该项目还有望降低广大研究人员、从业者和机器人进入GNN世界的障碍学习公司。本研究的教育和推广部分包括:1)本科生通过垂直整合研究项目的参与; 2)新的GNNs研究生课程; 3)科学-U计划的参与(为K-12的暑期科学夏令营)在宾夕法尼亚州立大学,和4)为高中女生和高中教师暑期讲习班。更具体地说,这个项目:1)探索GNN的理论基础,目标是确定收敛和可扩展性问题的根源,这对于在高性能应用中使用GNN时解决这些问题至关重要; 2)研究了一种支持GNN计算的与架构无关的编程语言,特别关注开发人员的生产力,语言表达能力和易扩展性(以确保它与现有的编程范式、模型和工具互操作); 3)探索编译器支持自动优化GNN应用程序并将其映射到新兴的硬件平台上(包括多核CPU、GPU和FPGA及其集成); 4)开发对GNN计算的自定义架构支持,目标是超越当前可编程硬件选项的性能; 5)对基于GNN的应用程序进行端到端的实验评估,以确定需要进一步关注的方面;最后6)开发一个基于GNN的基准测试套件,可用于各种硬件平台。这六个组成部分共同构成了一个多层生态系统,旨在了解和优化高性能、大规模的应用程序,这些应用程序可以从图驱动学习中受益。该奖项反映了NSF的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。
英文摘要
Many emerging high-performance applications from various domains of national importance (e.g., astrophysics, computational chemistry, drug discovery, and nuclear physics) employ large graph structures (with millions of nodes and edges connecting them) to represent their data, and perform different types of analytics on them, with the goal of understanding and extracting useful information from this massive data. While this graph-based analytics is fast becoming a fundamental piece of high-performance computing, existing analytics methods on graphs do not scale with increased hardware resources, mostly employ conventional machine learning/graph analysis strategies, and do not take full advantage of emerging heterogeneous compute and storage elements. As a result, the time-to-insight from large-scale graph-based data increases significantly, thereby slowing down scientific discoveries. Motivated by this observation, this NSF-funded project explores, from a holistic viewpoint, Graph Neural Networks (GNNs), a type of Neural Network which directly operates on graph structures, as a main tool to optimize various high-performance applications that benefit from machine learning and data analytics. This project has the ultimate goal of making the transitioning from existing machine learning mechanisms to GNNs smooth and effective in a variety of application domains. By facilitating more efficient and cost-effective use of hardware resources that are provided by custom clusters, supercomputers and cloud systems, this project is also expected to reduce the barrier to entry to the GNN world for a broad population of researchers, practitioners, and machine learning companies. The educational and outreach components of this research include 1) undergraduate student involvement via vertically integrated research projects; 2) a new graduate course on GNNs; 3) participation of Science-U program (a summer science camp for K-12) at Penn State, and 4) summer workshops for high school girls and high school teachers.More specifically, this project: 1) explores the theoretical foundations of GNNs with the goal of identifying the roots of convergence and scalability problems, which are critical to address when employing them in high-performance applications; 2) investigates an architecture-agnostic programming language support for GNN computations, focusing in particular on developer productivity, language expressiveness, and ease of extensibility (to ensure that it inter-operates with existing programming paradigms, models ,and tools); 3) explores compiler support for automatically optimizing and mapping GNN applications onto emerging hardware platforms (including multicore CPUs, GPUs, and FPGAs as well as their ensembles); 4) develops custom architecture support for GNN computations, with the goal of exceeding the performance of current programmable hardware options; 5) carries out an end-to-end experimental evaluation of GNN-based applications to identify the aspects that require further attention; and finally 6) develops a GNN-based benchmark suite that can be used on a wide variety of hardware platforms. These six components collectively form a multi-layer ecosystem tuned to understand and optimize high-performance, large-scale applications that can benefit from graph-driven learning.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
期刊论文(2)
专著(0)
科研奖励(0)
会议论文
DOI: --
发表时间: 2021-11
期刊: ArXiv
影响因子: --
作者: [M. Ramezani;Weilin Cong;Mehrdad Mahdavi;M. Kandemir;A. Sivasubramaniam]
通讯作者: M. Ramezani;Weilin Cong;Mehrdad Mahdavi;M. Kandemir;A. Sivasubramaniam
DOI: --
发表时间: 2020
期刊:
影响因子: --
作者: [M. Ramezani;Weilin Cong;M. Mahdavi;A. Sivasubramaniam;M. Kandemir]
通讯作者: M. Ramezani;Weilin Cong;M. Mahdavi;A. Sivasubramaniam;M. Kandemir
CAREER: Foundations of Collaborative Machine Learning
国内基金
海外基金
昼夜节律性small RNA在血斑形成时间推断中的法医学应用研究
  • 批准号:
  • 项目类别:
    省市级项目
  • 资助金额:
    --
  • 批准年份:
    2024
  • 负责人:
  • 依托单位:
tRNA-derived small RNA上调YBX1/CCL5通路参与硼替佐米诱导慢性疼痛的机制研究
  • 批准号:
  • 项目类别:
    省市级项目
  • 资助金额:
    10.0万元
  • 批准年份:
    2022
  • 负责人:
    张祥忠
  • 依托单位:
Small RNA调控I-F型CRISPR-Cas适应性免疫性的应答及分子机制
Small RNAs调控解淀粉芽胞杆菌FZB42生防功能的机制研究
  • 批准号:
    31972324
  • 项目类别:
    面上项目
  • 资助金额:
    58.0万元
  • 批准年份:
    2019
  • 负责人:
    高学文
  • 依托单位: