SBIR Phase II: MPI-2: A Systematic Study, Design, and Commercialization of the Extended Message Passing Interface for NOWs and Parallel Computers

这个小企业创新研究第二阶段项目建立在MPI软件技术公司（MSTI）丰富的MPI-1实施经验的基础上，我们在第一阶段开发了MPI-2设计，以便继续研究和先进的MPI-2标准的高质量实施的原型，用于工作站集群。在第二阶段，我们以第一阶段创建的原型为基础，同时继续研究可扩展的动态过程启动、单侧通信、集体操作和并行I/O的先进和多算法方法。我们的研究和开发成果将使高性能计算社区能够释放最新工作站和网络技术的潜力，为系统和软件的架构增强以及更复杂的计算环境提供访问。进行这项工作的理由是，科学界需要增强其最重要的并行处理环境MPI，并且工作站集群目标包含并行处理环境中增长最快的组件。为高性能计算发明MPI-2能力，代表着科学家和工程师能够广泛地创造新的科学，同时结合计算机科学本身的挑战，包括研究和高级开发性质。为了创建一个有用的MPI-2环境，必须解决重大的软件、协议和算法挑战。MPI-2的动态进程管理将支持几类新的科学应用程序和计算策略。其中包括计算服务器、增长/收缩并行应用程序和多学科代码。对单侧模型的支持将使需要细粒度通信支持的应用程序类成为可能，包括某些稀疏矩阵算法，以及利用全局数组类型算法的量子化学代码（例如，Focker-Planck计算）。对有效的通信人员集体操作的支持将简化和启用使用数据流模型的应用程序，包括复合并行模拟和可视化技术。对MPI-2的I/O技术的支持将支持无数核外和数据库类型的应用，包括对MPI金融建模日益增长的兴趣，以及气候和天气建模领域的传统科学问题，以及其他需要与并行计算相结合的大型核外数据集。

This Small Business Innovation Research Phase II project builds on MPI Software Technology, Inc.'s (MSTI's) extensive MPI-1 implementation experience with our MPI-2 design developed in Phase I in order to continue research and advanced prototyping of a quality implementation of the MPI-2 standard for clusters of workstations . In Phase II, we build upon prototypes created in Phase I, while continuing our investigations into scalable dynamic process startup, advanced and poly-algorithmic approaches to one-sided communications, collective operations, and parallel I/O. Our research and development outcomes will enable the high-performance computing community to unlock the potential of the latest workstation and networking technology, providing access to architectural enhancements of systems and software, and more complex computational environments. Rationale for undertaking this effort is that the scientific community needs enhancements to its most important parallel processing environment, MPI, and that workstation cluster targets comprise the fastest growing component of parallel processing environments. Inventing MPI-2 capability for HPC represents widely enabling technology for scientists and engineers to produce new science, while incorporating computer-science challenges of its own, both of a research and advanced development nature. Significant software, protocol, and algorithmic challenges must be tackled in order to create a useful MPI-2 environment.MPI-2's dynamic process management would support several classes of new scientific applications, and computation strategies. These include computational servers, growing/shrinking parallel applications, and multi-disciplinary codes. Support for the one-sided model would enable classes of applications that need fine grain communication support, including certain sparse matrix algorithms, as well as quantum chemistry codes that utilize global array-type algorithms (e.g., Focker-Planck computations) . Support for effective intercommunicator collective operations would simplify and enable applications that work with dataflow models, including composite parallel simulation and visualization techniques. Support for MPI-2's I/O techniques would support myriad out-of-core and database-type applications, including growing interest in financial modeling with MPI, but also the traditional scientific problems in areas of climate and weather modeling, and others with large, out-of-core datasets needed in conjunction with parallel computing.