An edge-aware autonomic runtime for data streaming and in-transit processing
An edge-aware autonomic runtime for data streaming and in-transit processing
复制标题
用于数据流和传输中处理的边缘感知自主运行时
DOI：
10.1016/j.future.2020.03.037
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
Parashar, Manish
中科院分区：
文献类型：
--
作者：
Zamani, Ali Reza;Balouek-Thomert, Daniel;Villalobos, J.J.;Rodero, Ivan;Parashar, Manish
One of the major endeavors of modern cyberinfrastructure (CI) is to carry content produced on remote data sources, such as sensors and scientific instruments, and to deliver it to end users and workflow applications. Maintaining data quality, data resolution, and on-time data delivery and considering the increasing number of computing, storage, and network resources are challenging tasks that require a receptive system able to adapt to ever-changing demands. In this paper, we propose a mathematical model of such system by expressing the dynamic stages of different resources in the context of edge and in-transit computing. By considering resource utilization, approximation techniques, and user constraints, our proposed model generates mappings of different workflow stages on heterogeneous geographically distributed resources. Specifically, we propose an autonomic runtime management layer that adapts the data resolution being delivered to the users by implementing feedback loops over the resources involved in the delivery and processing of data streams. The implementation of our model is based on a subscription-based data streaming framework that enables the integration of large facilities and advanced CI. Moreover, the idea of stream or request aggregation is incorporated into our framework, which eliminates redundant data streams to save bandwidth. Experimental results show that dynamically adapting data resolution and stream aggregation can overcome bandwidth limitations in wide-area streaming analytics by leveraging the resources at the edge and in-transit.
登录
查看更多内容
计算和数据支持的科学与工程的云范式和实践
DOI：
--
发表时间：
2013
期刊：
Computing in science & engineering (Print)
影响因子：
--
作者：
M. Parashar;Moustafa AbdelBaky;I. Rodero;Aditya Devarakonda
通讯作者：
Aditya Devarakonda
通过传输中计算环境进行截止时间约束的视频分析
影响因子：
8.1
作者：
A. Zamani;Mengsong Zou;J. Diaz;I. Petri;O. Rana;A. Anjum;M. Parashar
通讯作者：
M. Parashar
数据密集型网格工作流程的传输中处理实验
DOI：
--
发表时间：
2007
期刊：
IEEE/ACM International Conference on Grid Computing
影响因子：
--
作者：
V. Bhat;M. Parashar;S. Klasky
通讯作者：
S. Klasky
支持大型天文台启用的数据驱动工作流程
DOI：
10.1109/escience.2017.95
发表时间：
2017
期刊：
2017 IEEE 13th International Conference on e-Science (e-Science
影响因子：
--
作者：
Zamani, Ali Reza;AbdelBaky, Moustafa;Balouek-Thomert, Daniel;Rodero, Ivan;Parashar, Manish
通讯作者：
Parashar, Manish
海洋观测站倡议 (OOI) 的持续观测
DOI：
--
发表时间：
2020
期刊：
影响因子：
--
作者：
A. Plueddemann;J. Trowbridge;E. Dever;D. Kelley;M. Brennan
通讯作者：
M. Brennan