Supporting climate research using named data networking
Supporting climate research using named data networking
复制标题
使用命名数据网络支持气候研究
DOI：
--
复制
发表时间：
2014
期刊：
影响因子：
--
通讯作者：
C. Papadopoulos
中科院分区：
文献类型：
--
作者：
C. Olschanowsky;Susmit Shannigrahi;C. Papadopoulos
气候和其他大数据应用在数据存储、检索、共享和管理方面面临重大问题。虽然有几个社区存储库和工具可以帮助处理气候数据，但这些问题仍然存在，社区正在积极寻找更好的解决方案。在这个项目中，我们应用NDN来支持气候建模应用程序。NDN以信息为中心的特性，其中内容成为第一类实体，简化了该领域中的许多问题。与基于IP的解决方案相比，NDN提供轻量级的数据发布、发现和检索。然而，将一个新的网络架构引入一个成熟的领域，这个领域通常会产生PB级的数据集和大量的各种工具来操作它们，这是一个有风险的提议。NDN本身的优势可能不足以克服自然惯性。我们的方法是引入NDN，同时小心避免对现有工作流程造成不必要的中断。在这种程度上，我们采用了一个用户界面，该界面采用熟悉的文件系统操作来发布，发现和检索数据，并与特定于域的转换器集成，这些转换器可以自动转换和发布数据集作为NDN对象。我们概述了NDN在这一应用领域的优势和我们在适应过程中面临的挑战。我们相信这是在现有的、大型的、成熟的应用领域中应用NDN的第一次实践。
Climate and other big data applications face substantial problems in terms of data storage, retrieval, sharing and management. While several community repositories and tools are available to help with climate data, these problems still persist and the community is actively looking for better solutions. In this project we apply NDN to support climate modeling applications. The information-centric nature of NDN, where content becomes a first class entity, simplifies many of the problems in this domain. NDN offers lightweight data publication, discovery and retrieval compared to IP-based solutions. However, introducing a new network architecture to a mature domain that routinely produces petabytes of datasets and a plethora of assorted tools to manipulate them, is a risky proposition. The advantages of NDN alone may not be sufficient to overcome the natural inertia. Our approach is to introduce NDN while carefully avoiding undue disruption to existing workflows. To that extent we employ a user interface that employs familiar filesystem operations to publish, discover and retrieve data, integrated with domain-specific translators that automatically convert and publish datasets as NDN objects. We outline the advantages of NDN in this application domain and the challenges we faced during the adaptation. We believe this is the first exercise in applying NDN in an existing, large, mature application domain.