Towards a Dataflow Platform in a Hierarchical Network: A Proposal for a Dataflow Component Management Method
Towards a Dataflow Platform in a Hierarchical Network: A Proposal for a Dataflow Component Management Method
复制标题
DOI：
10.2197/ipsjjip.28.599
复制
发表时间：
2020-09
期刊：
影响因子：
--
通讯作者：
Shintaro Ishihara;Toyokazu Akiyama
中科院分区：
文献类型：
--
作者：
Shintaro Ishihara;Toyokazu Akiyama
：物联网应用产生大量数据流，用于控制现实环境。为了维持长期运行的物联网应用成本，考虑分层网络特征（例如利用边缘资源），降低网络流量和延迟变得非常重要。这种数据流平台的研究和开发正在进行中，该平台使应用程序开发人员能够通过组合可重用的软件组件来构建新的数据流应用程序。然而，现有的数据流平台不支持组件管理，其中包括应用程序部署和放置选择，假设是分层网络环境。为了实现分层网络中的数据流平台，我们提出了一种使用主流开源产品将组件部署到异构环境中的方法，并考虑网络集群的结构，实现大规模部署。然后，结合平台的网络和资源条件，提出了一种组件部署层选择方法。在组件放置问题的定义过程中，我们还提取了估算组件部署预算所需的参数，即数据流平台参数、数据流应用参数和数据流应用组件参数。此外，我们基于两个用例实现了一个简单的数据流应用程序，并验证了所提出方法的有效性。
: Massive dataflows are generated from IoT applications for controlling real-world environments. For maintaining the long-running IoT application costs, it becomes important to reduce network tra ffi c and delay considering hierarchical network characteristics, e.g., leveraging edge resources. Research and development of such a dataflow platform are ongoing, and the platform enables application developers to build a new dataflow application by just combining reusable software components. However, the existing dataflow platform does not support component management, which includes application deployment and placement selection, assuming the hierarchical network environments. In this paper, to realize the dataflow platform in a hierarchical network, we proposed an approach to deploy components into heterogeneous environments using a major open-source product and to enable the large-scale deployment by considering the structure of network clusters. Then, a component deployment layer selection method is also proposed considering network and resource conditions in the proposed platform. During the definition of the component placement problem, we also extracted parameters, which are dataflow platform parameters, dataflow application parameters and dataflow application component parameters, required to estimate component deployment budgets. Furthermore, we implemented a simple dataflow application based on two use cases and confirmed the validity of the proposed method.