DCS: Ganga: Removing the Semantic Gap between Stream-based Applications and Stream Accelerators

项目描述PI计划开发一个新的分布式编程框架Ganga，它解决了新兴应用领域和目标平台之间日益增长的差距。框架的核心是一个新的抽象胶囊，体现了计算和状态。该应用程序是一个由数据流连接的胶囊的简单图。该programmingmodel不需要应用程序员提供明确的映射和分布的thecaptures的目标平台的节点（包括集群和传感器网络）。智力优点一个语义干净，简单的模型，用于编程复杂的分布式应用程序是智力的优点之一，建议的研究。封装抽象的语义模拟了许多已知的分布式计算范例，如RPC、活动消息、延续和未来。运行库自动决定与应用程序的动态需求和目标平台的动态资源可用性相称的适当语义。运行时系统中的机制包括将胶囊划分成由流连接的更细胶囊的能力，将更细胶囊合并成使连接它们的流内在化的更粗粒度胶囊的能力，胶囊在计算节点之间的迁移，重新启动失败的胶囊，和内存资源的垃圾收集。还在系统级应用的致动表征以协调资源管理决策。系统状态被感知，并且决策实体重新评估（并且如果需要，改变）资源的使用。发展这样一个特征是拟议的研究的另一个智力价值。更广泛的影响随着学科的成熟，很明显，计算必须与领域专家接口，以增加计算在社会景观中的相关性和重要性。尤其重要的是，为最终用户开发简单直观的界面，以隐藏新兴的分布式硬件平台的复杂性。通过瞄准具有潜在社会效益的应用领域，增强了拟议研究的重要性。PI计划通过与工业界的合作，将这个项目的研究成果进行技术转移。Ganga将成为一个有趣的并行教学工具。它在一个干净的模型中干净地结合了已知的并行风格。它暴露了所有的大问题，同时隐藏了无趣的细节。PI旨在将该系统用于教育目的。在格鲁吉亚理工学院有一个关于普及计算的活跃的教育项目。这些技术的一个适当的可用性测试是使系统可用于类项目的分布式系统的新手用户在普适计算类在本科生和研究生水平。

Project DescriptionThe PI plans to develop a novel distributed programming framework, Ganga, which addresses theincreasing gap between the emerging application domains and the target platforms.At the heart of the framework is a new abstraction capsule that embodies computation and state. Theapplication program is a dataflow graph of capsules connected by streams of data. The programmingmodel does not require the application programmer to provide explicit mapping and distribution of thecapsules to the nodes of the target platform (comprising of clusters and sensor networks).Intellectual Merit A semantically clean and simple model for programming complex distributed applications is one of the intellectual merits of the proposed research. The semantics of the capsule abstraction emulates many of the known paradigmsfor distributed computing such as RPC, active messages, continuations, and futures. The runtime automatically decides the appropriate semantics commensurate with the dynamic needs of the application and the dynamic resource availability of the target platform. Mechanisms in the runtime system include the ability to partition the capsule into finer capsules connected by streams, coalescing finer capsules into a coarser grain one internalizing the streams that connected them, migration of capsules among the computational nodes, restarting failed capsules, and garbage collection of memory resources.The sense-process-actuate characterization of the application is also applied at the system level to orchestrate the resource management decisions. The system state is sensed and the decision-making entityre-evaluates (and if need be, alters) the use of the resources. Developing such a characterization is anotherintellectual merit of the proposed research.Broader ImpactAs the discipline matures, it is clear that computing has to interface with domain experts to increase the relevance and importance of computing in the societal landscape. In particular, it is important to develop simple and intuitive interfaces for the end user that hide the complexities of the emerging distributed hardware platforms. By targeting application domains that have the potential for societal benefits, the importance of the proposed research is enhanced. Th PIs plan to do technology transfer of the research artifacts from this project through their partnership with industry.Ganga will be an interesting tool for teaching about parallelism. It cleanly incorporates known styles ofparallelism in a single clean model. It exposes all the big issues while hiding the uninteresting details. It is the PIs intent to put the system into use for educational purposes. There is an active educational program at Georgia Tech in pervasive computing. An appropriate usability test of these technologies is to make the system available for class projects by novice users of distributed systems in pervasive computing classes both at the undergraduate and graduate levels.