A Distributed Topic-Based Pub/Sub Method for Exhaust Data Streams towards Scalable Event-Driven Systems
A Distributed Topic-Based Pub/Sub Method for Exhaust Data Streams towards Scalable Event-Driven Systems
复制标题
一种基于分布式主题的发布/订阅方法，用于将数据流排出到可扩展的事件驱动系统
DOI：
10.1109/compsac.2014.44
复制
发表时间：
2014
期刊：
影响因子：
--
通讯作者：
M. Matsuo
中科院分区：
文献类型：
--
作者：
Ryohei Banno;Susumu Takeuchi;M. Takemoto;T. Kawano;Takashi Kambayashi;M. Matsuo
分布式发布/订阅消息传递已经成为事件驱动系统不可或缺的。存在通过使用结构化覆盖网络来实现关于基于主题的发布/订阅的高可伸缩性的方法。然而，这些方法浪费了与“耗尽数据”有关的网络资源，这些数据在大多数时间内价值很低或没有价值。存在至少两个问题：即使不存在订户，每个发布者节点也继续将数据转发到中继节点，并且构造了对于低值数据而言过大的多播树，即具有少量订户。本文通过定义“强无中继”性质作为无中继性质的扩展，阐述了覆盖网络的要求，并提出了一种利用跳跃图来满足该性质的实用方法。所提出的方法涉及发布者和订阅者组成连接的子图，以使检测用户的情况下，自主调整树的大小。通过仿真实验，验证了该方法能够自适应地暂停发布，在10万节点的实验条件下，多播树上的路径长度缩短了75%以上。所提出的方法是主管分散的事件驱动的系统，鼓励本地生产的数据在本地消费。
Distributed pub/sub messaging has become indispensable for event-driven systems. There are methods for achieving high scalability regarding topic-based pub/sub by using structured overlay networks. However, these methods waste network resources concerning "exhaust data," which have low or no value most of the time. There are at least two problems: each publisher node continues to forward data to a relay node even if there are no subscribers, and multicast trees are constructed which are excessively large for low value data, namely having a small number of subscribers. In this paper, we formulate the requirements of overlay networks by defining a property called "strong relay-free" as an expansion of relay-free property, and propose a practical method satisfying the property by using Skip Graph. The proposed method involves publishers and subscribers composing connected sub graphs to enable detecting the absence of subscribers and autonomously adjusting the tree size. Through simulation experiments, we confirmed that the proposed method can suspend publishing adaptively, and shorten the path length on multicast trees by more than 75% under an experimental condition with 100,000 nodes. The proposed method is competent for decentralized event-driven systems with encouraging the locally produced data to be consumed locally.
DOI：
--
发表时间：
2006
期刊：
Journal of IEICE Vol.89, No.2
影响因子：
--
作者：
Taku Noguchi;Miki Yamamoto
通讯作者：
Miki Yamamoto