Collaborative Research: CC-NIE Integration: An Open Cloud Infrastructure for Scalable Data Intensive Collaboration

所有人都说，从新仪器、传感器网络和大规模模拟中产生的数据流的规模继续急剧上升。因此，许多大型国家和国际合作的研究人员，坐在不同的行政领域，分布在广域网上，使用不同的当地资源，很可能会发现，最感兴趣的数据集不是他们需要的地方，当他们需要的时候，为了他们的工作有效地进行。很明显，校园级桥接的适当网络基础设施战略必须解决数据物流领域的这些关键问题。该项目创建了一个数据物流工具包（DLT），这是一个易于安装的生产质量软件包，用于构建支持wan的存储节点，从而大大提高数据密集型研究社区在广泛领域的协作能力。支持dlt的服务（例如，用于支持自动数据定位的研究的全球“下拉箱”）可以使用策略控制的共享、复制、缓存、控制环路优化和覆盖多播，在广泛的场景中实现数据及时放置的自动化和优化。DLT提供熟悉的用户和编程接口，并以可靠但可扩展的安全框架为支持，通过为基本的后勤资源（存储）提供通用接口，并为具有DLT节点的校园提供网络意识和适应性，以最大限度地提高其广域链接到分布式数据和计算资源的生产力，从而改变了全球数据密集型协作。

By all accounts, the size of the data flows pulsing out of new instruments, sensor networks and massive simulations continues to escalate dramatically. Consequently many researchers in large national and international collaborations, sitting in different administrative domains, spread across the wide area network, and using diverse local resources, are likely to find that the data sets of most current interest are not where they need to be, when they need to be there, for their work to proceed efficiently. It is clear that an adequate cyberinfrastructure strategy for campus level bridging must address such critical problems in the area of data logistics.This project creates a Data Logistics Toolkit (DLT) - an easy to install package of production quality software for building WAN-enabled storage nodes that dramatically improve the ability of data intensive research communities to collaborate in the wide area. DLT-enabled services (e.g. a global "drop box" for research that supports automatic data positioning) enable the automation and optimization of the timely placement of data across a wide range of scenarios, using policy-controlled sharing, replication, caching, control loop optimization and overlay multicast. Offering familiar user and programming interfaces, and backed by a solid but scalable security framework, the DLT transforms global data-intensive collaboration by providing a generic interface to an essential logistical resource - storage - and by giving campuses with DLT-enabled nodes the network awareness and adaptivity needed to maximize the productivity of their wide area links to distributed data and computing resources.