BIGDATA: Small: DCM: Open Flow Enabled Hadoop over Local and Wide Area Clusters

大数据：小：DCM：开放流支持本地和广域集群上的Hadoop Robert L.近年来，使用Hadoop和MapReduce进行数据密集型编程变得越来越重要。 正如通常部署的那样，Hadoop在多机架集群中实现MapReduce取决于机架交换机和连接多个机架的聚合器交换机的顶部。 要在许多机架上大规模有效地使用Hadoop，需要昂贵的网络交换机和路由器，这些交换机和路由器的配置和维护都很复杂。使用OpenFlow的软件定义网络在许多情况下都被证明可以以更低的成本提供良好的性能，并且更易于管理。 该提案的第一个目标是促进Hadoop新版本的开发，称为Hadoop-OFP。 Hadoop-OFP的基本思想是将支持OpenFlow的交换机与Hadoop集成：i）提高性能; ii）降低所需硬件的成本; iii）简化集群的管理。 大型数据流也是数据密集型计算的关键组成部分。 不幸的是，建立网络来管理大型数据流可能具有挑战性。 该提案的第二个目标是开发一种工具，可以配置OpenFlow启用网络，以更有效地处理数据密集型计算产生的大型数据流。

BigData: Small: DCM: Open Flow Enabled Hadoop over Local and Wide Area ClustersRobert L. GrossmanUniversity of ChicagoIn the recent years, data intensive programming using Hadoop and MapReduce has become more and more important. As normally deployed, Hadoop's implementation of MapReduce in a multi-rack cluster is dependent upon the top of the rack switches and of the aggregator switches connecting multiple racks. To use Hadoop effectively at scale across many racks requires expensive network switches and routers that are complex to configure and to maintain.Software defined networks using OpenFlow have proven in many cases to offer good performance at lower cost and to be simpler to manage. The first goal of this proposal is to contribute to the development of a new version of Hadoop called Hadoop-OFP. The basic idea of Hadoop-OFP is to integrate OpenFlow enabled switches with Hadoop: to i) improve performance; ii) lower the cost of the hardware required; and iii) simplify the management of the cluster. Large data flows are also a critical component of data intensive computing. Unfortunately, setting up networks to manage large data flows can be challenging. A second goal of this proposal is to develop a tool that can configure OpenFlow enabled networks to handle more efficiently the large data flows that arise with data intensive computing.