SBIR Phase II: MPI-2: A Systematic Study, Design, and Commercialization of the Extended Message Passing Interface for NOWs and Parallel Computers

这个小型企业创新研究第二阶段项目建立在MPI软件技术公司S丰富的MPI-1实施经验的基础上，我们在第一阶段开发的MPI-2设计是为了继续研究和为工作站集群的MPI-2标准的高质量实施进行高级原型研究。在第二阶段，我们在第一阶段创建的原型的基础上，继续研究可扩展的动态流程启动、单边通信、集体操作和并行I/O的高级和多算法方法。我们的研究和开发成果将使高性能计算社区能够释放最新工作站和网络技术的潜力，提供对系统和软件的体系结构增强以及更复杂的计算环境的访问。进行这项工作的理由是，科学界需要增强其最重要的并行处理环境MPI，而工作站集群目标构成并行处理环境中增长最快的组成部分。为高性能计算机发明MPI-2功能代表着广泛支持科学家和工程师产生新科学的技术，同时纳入了计算机科学本身的挑战，既有研究性质的，也有高级开发性质的。为了创建一个有用的MPI-2环境，必须解决重大的软件、协议和算法挑战。MPI-2的S动态过程管理将支持几类新的科学应用和计算策略。其中包括计算服务器、增长/缩小的并行应用程序和多学科代码。对单边模型的支持将支持需要细粒度通信支持的各类应用，包括某些稀疏矩阵算法，以及利用全局阵列型算法(例如，福克-普朗克计算)的量子化学码。对有效的互通器集体操作的支持将简化和支持使用数据流模型的应用程序，包括复合并行模拟和可视化技术。对MPI-2的S I/O技术的支持将支持无数核心外和数据库类型的应用程序，包括对使用MPI进行金融建模的日益增长的兴趣，但也支持气候和天气建模领域的传统科学问题，以及其他需要与并行计算相结合的大型核心外数据集的应用程序。

This Small Business Innovation Research Phase II project builds on MPI Software Technology, Inc.'s (MSTI's) extensive MPI-1 implementation experience with our MPI-2 design developed in Phase I in order to continue research and advanced prototyping of a quality implementation of the MPI-2 standard for clusters of workstations . In Phase II, we build upon prototypes created in Phase I, while continuing our investigations into scalable dynamic process startup, advanced and poly-algorithmic approaches to one-sided communications, collective operations, and parallel I/O. Our research and development outcomes will enable the high-performance computing community to unlock the potential of the latest workstation and networking technology, providing access to architectural enhancements of systems and software, and more complex computational environments. Rationale for undertaking this effort is that the scientific community needs enhancements to its most important parallel processing environment, MPI, and that workstation cluster targets comprise the fastest growing component of parallel processing environments. Inventing MPI-2 capability for HPC represents widely enabling technology for scientists and engineers to produce new science, while incorporating computer-science challenges of its own, both of a research and advanced development nature. Significant software, protocol, and algorithmic challenges must be tackled in order to create a useful MPI-2 environment.MPI-2's dynamic process management would support several classes of new scientific applications, and computation strategies. These include computational servers, growing/shrinking parallel applications, and multi-disciplinary codes. Support for the one-sided model would enable classes of applications that need fine grain communication support, including certain sparse matrix algorithms, as well as quantum chemistry codes that utilize global array-type algorithms (e.g., Focker-Planck computations) . Support for effective intercommunicator collective operations would simplify and enable applications that work with dataflow models, including composite parallel simulation and visualization techniques. Support for MPI-2's I/O techniques would support myriad out-of-core and database-type applications, including growing interest in financial modeling with MPI, but also the traditional scientific problems in areas of climate and weather modeling, and others with large, out-of-core datasets needed in conjunction with parallel computing.