CSR:Medium: Systems and Software Research for Compute-Intensive Cloud Computing

商业、高科技部门最近的一个趋势是向公众提供大规模、专有的计算和存储基础设施。Amazon、b谷歌等公司支持通过Internet访问这些庞大的资源集合，并为访问它们提供了广泛的服务（工具、api、资源调度和会计等）。鼓励用户将基础设施视为一个不透明的计算“云”，它以与网络“云”提供网络连接相同的方式提供计算和存储功能：通过由定义良好的接口控制的客户端-提供者关系。不幸的是，目前，云计算技术仅为来自web服务领域的一组有限的应用程序提供支持。因此，到目前为止，远程管理的网络托管是云系统最普遍的使用模式。通过这项研究，pi建议设计、实现和评估两个最流行的云供应商（Amazon.com和b谷歌）提供的服务的扩展，以促进需要支持一般计算密集型应用程序的更广泛的开发人员基础（例如，科学家和学生）的使用。这项工作的基础将是两个能够在学术环境中实现商业云计算功能的新颖研究项目：AppScale和Eucalyptus。pi将使用这些基础设施来调查和贡献现有云技术中缺失的三种基本技术，这些技术对于支持基于云的集群中的高性能计算密集型应用是必要的：共享内存进程间通信的有效支持，高性能文件系统支持，以及系统范围的自适应性能监控和分析。

A recent trend in the commercial, high-technology sector has been to make large-scale, proprietary computing and storage infrastructure available to the public. Companies such as Amazon, Google, and many others, enable access to these vast resource collections via the Internet, and provide a wide range of services for accessing them (tools, APIs, resource scheduling and accounting, etc.). Users are encouraged to think of the infrastructure as a an opaque computing ``cloud'' that delivers compute and storage capabilities in the same way that the network ``cloud'' delivers network connectivity: through a client-provider relationship governed by well-defined interfaces.Unfortunately, at present, cloud computing technologies provide support for only a limited set of applications from the web service domain. As a result, remotely managed web hosting is, by far, the most prevalent usage model for cloud systems.With this research, the PIs propose to design, implement, and evaluate the extensions to the services offered by the two most prevalent cloud purveyors (Amazon.com and Google) to facilitate usage by a more broad developer base (e.g., scientists and students) who require support for general compute-intensive applications. The basis of this work will be two novel research projects that are able to implement commercial cloud computing functionality in academic settings: AppScale and Eucalyptus.The PIs will employ these infrastructures to investigate and contribute the three fundamental technologies that are missing from extant cloud technologies but that are necessary to enable support of high-performance, compute intensive applications within cloud-basedclusters: efficient support of shared-memory inter-process communication, high-performance file system support, and system-wide, adaptive performance monitoring and analysis.