PFI:AIR - TT: Automated Out-of-Core Execution of Parallel Message-Passing Applications

该PFI：AIR技术翻译项目专注于翻译软件技术，以满足在物理内存有限的架构上执行并行应用程序的需求。这种称为BDMPI（大数据消息传递接口）的软件技术非常重要，因为它将允许依赖于计算建模和仿真的方法有效且经济地解决现有和即将推出的计算机系统上的非常大的问题，其中许多都针对低功耗进行了优化。这种能力将对许多科学工程学科、政府、国防、商业公司和非营利组织产生积极影响。该项目将产生BDMPI的软件原型。BDMPI相对于竞争方法的优点在于：（i）它允许以MPI（消息传递接口）编写的现有并行程序自动切换到高效的基于磁盘的执行，而无需软件再工程努力，以及（ii）它提供了用于开发基于磁盘的分布式程序的灵活框架，该分布式程序可以实现比领先的竞争方法更高的性能水平（例如，该项目解决了以下技术差距，因为它从研究发现转化为商业应用。它将扩展BDMPI以支持MPI标准API（应用程序编程接口）的一个大子集，它将优化其运行时系统，以便减少与基于磁盘的执行相关的开销，它将实现容错功能，并且它将优化其固态磁盘的运行时系统。此外，参与该项目的人员（研究生和本科生）将通过Step-It-Up计划获得创新，创业和技术商业化经验，该计划将学生置于支持和执行商业化工作的兼职角色，他们参加“创新培训”研讨会，并在专利申请起草期间与律师互动。

This PFI: AIR Technology Translation project focuses on translating a software technology to fill the need for executing parallel applications on architectures with limited physical memory. This software technology, called BDMPI (Big Data Message Passing Interface), is important because it will allow approaches that rely on computational modeling and simulation to efficiently and economically solve very large problems on existing and upcoming computer systems, many of which are optimized for low power. This capability will positively impact many science & engineering disciplines, government, defense, commercial companies, and non-profit organizations. The project will result in a software prototype of BDMPI. The advantages of BDMPI over competing approaches are that (i) it allows existing parallel programs written in MPI (Message Passing Interface) to automatically switch to an efficient disk-based execution with no software re-engineering efforts, and (ii) it provides a flexible framework for developing disk-based distributed programs that can achieve levels of performance that are higher than leading competing approaches (e.g., Hadoop).This project addresses the following technology gap(s) as it translates from research discovery toward commercial application. It will expand BDMPI to support a large subset of MPI's standard API (Application Programming Interface), it will optimize its runtime system so that to reduce the overheads associated with disk-based execution, it will implement fault tolerance features, and it will optimize its runtime system for solid-state disks. In addition, the personnel involved in this project (graduate and undergraduate students), will receive innovation, entrepreneurship, and technology commercialization experiences through the Step-It-Up program that places students in part-time roles of supporting and performing commercialization efforts, their participation in an "Innovation Training" workshop, and by interacting with attorneys during patent application drafting.