Collaborative Research: Topology-Aware MPI Communication and Scheduling for Petascale Systems
Collaborative Research: Topology-Aware MPI Communication and Scheduling for Petascale Systems
批准号:
0926574
负责人:
Karl Schulz
金额:
$45.99万
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2009
资助国家:
美国
项目状态:
已结题
起止时间:
2009-10-01 至 2013-09-30
中文摘要
该奖项是根据2009年《美国复苏和再投资法案》(公法111-5)资助的。现代网络(如InfiniBand和10GigE)具有在运行时提供拓扑、路由以及网络状态信息的能力。这带来了以下广泛的挑战:下一代Petascale系统能否提供拓扑感知的MPI通信、映射和调度,从而提高一系列应用的性能和可扩展性?这一挑战导致了以下研究问题:1)Petascale应用对拓扑感知的通信和调度要求是什么?2)如何设计一个具有静态和动态网络信息的网络拓扑和状态管理框架?3)如何在MPI库中设计拓扑感知的点对点和集合通信方案(如广播、全对全、全约)?4)如何设计拓扑感知的任务映射和调度方案?5)如何定义和设计灵活的拓扑信息接口?俄亥俄州立大学(OSU)的计算机科学家以及德克萨斯高级计算中心(TACC)和大学的计算科学家参与的协同和综合研究计划。加州圣地亚哥的圣地亚哥超级计算机中心(SDSC)就是为了应对上述挑战而提出的。这项研究将由一组应用程序(PSDNS、UCSDH3D、AWM-Olsen和MPCUGLES)驱动,这些应用程序来自NSF计算科学研究人员在Ranger系统和其他NSF HEC系统上运行的大规模模拟。拟议研究的变革性影响是开发支持拓扑的MPI软件和使用派生的拓扑信息进行调度集成的框架,以便最大限度地提高Petascale应用程序的性能。这项拟议的研究是计算机科学家和计算科学家之间的协作和协同活动,因此,将对制定设计、部署和使用下一代Petascale系统的指导方针产生重大影响。提出的研究方向和解决方案将用于调查人员的课程,以培养研究生和本科生。TACC和SDSC建立的全国性培训和推广方案将用于向HEC用户和开发人员传播这项研究的结果。研究结果还将分发给调查人员的多个合作组织(国家实验室和工业界),以便对其软件产品和应用程序产生影响。经修改的MVAPICH2库(目前由840多个组织使用)和SGE调度器插件将以开源方式提供给HEC社区。这项研究的案例研究将在MPI论坛(俄亥俄州立大学是该论坛的成员)上提交,以指导即将到来的MPI-3标准和其他MPI库的设计。
英文摘要
Abstract This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5). Modern networks (like InfiniBand and 10GigE) have capability to provide topology, routing and also network status information at run-time. This leads to the following broad challenge: Can the next generation petascale systems provide topology-aware MPI communication, mapping and scheduling which can improve performance and scalability for a range of applications? This challenge leads to the following research questions: 1) What are the topology- aware communication and scheduling requirements of petascale applications? 2) How to design a network topology and state management framework with static and dynamic network information? 3) How to design topology-aware point-to-point and collective communication schemes (such as broadcast, all-to-all, all-reduce) in an MPI library? 4) How to design topology-aware task mapping and scheduling schemes? and 5) How to define and design a flexible topology information interface? A synergistic and comprehensive research plan, involving computer scientists from The Ohio State University (OSU) and computational scientists from the Texas Advanced Computing Center (TACC) and The Univ. of Calif., San Diego, San Diego Supercomputer Center (SDSC), is proposed to address the above challenges. The research will be driven by a set of applications (PSDNS, UCSDH3D, AWM-Olsen and MPCUGLES) from established NSF computational science researchers running large scale simulations on the Ranger system and other NSF HEC systems. The transformative impact of the proposed research is to develop topology-aware MPI software and a framework for using derived topology information for scheduling integration in order to maximize petascale application performance. The proposed research is a collaborative and synergistic activity between computer scientists and computational scientists and thus, will have significant impact in deriving guidelines for designing, deploying and using next generation petascale systems. The proposed research directions and their solutions will be used in curriculum of the investigators to train graduate and undergraduate students. The established national-scale training and outreach programs at TACC and SDSC will be used to disseminate the results of this research to HEC users and developers. Research results will also be disseminated to the multiple collaborating organizations of the investigators (national laboratories and industry) to enable impact on their software products and applications. The modified MVAPICH2 library (currently being used by more than 840 organizations) and SGE scheduler plug-in will be available to the HEC community in an open-source manner. Case-studies from this research will be presented at the MPI Forum (OSU is a member of this forum) to influence the design of the upcoming MPI-3 standard and other MPI libraries.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Collaborative Research: Extending One-Sided Communication MPI Programming Model for Next -Generation Ultra-Scale HEC
-
批准号:0833139
-
项目类别:Standard Grant
-
资助金额:$19.9万
-
财政年份:2008
-
负责人:Karl Schulz
-
依托单位:
国内基金
海外基金
登录
查看更多内容
Research on Quantum Field Theory without a Lagrangian Description
-
批准号:24ZR1403900
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2024
-
负责人:SATOSHI NAWATA
-
依托单位:
Cell Research
-
批准号:31224802
-
项目类别:专项基金项目
-
资助金额:24.0万元
-
批准年份:2012
-
负责人:程磊
-
依托单位:
Cell Research
-
批准号:31024804
-
项目类别:专项基金项目
-
资助金额:24.0万元
-
批准年份:2010
-
负责人:程磊
-
依托单位:
Cell Research (细胞研究)
-
批准号:30824808
-
项目类别:专项基金项目
-
资助金额:24.0万元
-
批准年份:2008
-
负责人:张爱兰
-
依托单位:
Research on the Rapid Growth Mechanism of KDP Crystal
-
批准号:10774081
-
项目类别:面上项目
-
资助金额:45.0万元
-
批准年份:2007
-
负责人:滕冰
-
依托单位: