CRII: CI: Exploring Advanced Cyber-Infrastructure Co-Design for Big Data Analytics

CRII：CI：探索大数据分析的高级网络基础设施协同设计

• 批准号: 1464317
• 负责人: Ivan Rodero
• 金额: $ 17.13万
• 依托单位: Rutgers University New Brunswick
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-07-01 至 2018-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1464317&HistoricalAwards=false
• 关键词: CRII; CI; Exploring; Advanced; Cyber

The proliferation of digital data provides new opportunities in all areas of science, engineering and industry. However, the increasing data volumes and rates, and the associated costs in terms of latencies and energy, quickly dominate and limit data analytics applications' ability to leverage this data in an effective and timely manner. The co-design process enables scientists to reason about the rich design spaces available in software and hardware, and is expected to help in constructing a new class of cyber-infrastructure. Nevertheless, current solutions for big data analytics have important limitations that make these solutions infeasible for the next generation of cyber-infrastructure. As a result, exploring key co-design issues in the scope of big data analytics has become critical.The overarching goals of this research are to understand the performance and power behaviors and tradeoffs related to data placement, movement, and processing of big data analytics on systems with emerging architectures, and to develop models that can fundamentally enable big data analytics on ongoing cyber-infrastructure. In contrast to existing work, this research effort focuses on the co-design process that has been exploited in the context of large-scale scientific applications. Key research activities include building a framework to evaluate different classes of big data analytics, characterizing data analytics applications in terms of performance and power, and developing a methodology to construct models to understand and explore the design space.As data analytics applications become increasingly important in a wide range of domains, the ability to develop large-scale and sustainable platforms and software infrastructure to support these applications has significant potential to drive research and innovation in science and business domains. This project provides an understanding of hardware/software characteristics and requirements for big data analytics and future cyber-infrastructure design. These research activities are integrated with graduate and undergraduate student research, and leverage minority student outreach networks at Rutgers.

数字数据的扩散为科学，工程和行业的所有领域提供了新的机会。但是，增加的数据量和费率以及在潜伏期和能源方面的相关成本迅速占主导和限制数据分析应用程序以有效和及时的方式利用此数据的能力。共同设计的过程使科学家能够对软件和硬件中可用的丰富设计空间进行推理，并有望帮助构建一类新的网络基础结构。然而，当前的大数据分析解决方案具有重要的局限性，使这些解决方案对于下一代网络基础结构不可行。结果，探索大数据分析范围中的关键共同设计问题已经变得至关重要。这项研究的总体目标是了解与数据放置，移动和处理与新兴建筑的系统上的大数据分析相关的性能，权力行为和权衡，并可以基本地启用大型数据分析的模型，以基本上启用了cyer cybersunterics。与现有工作相反，这项研究工作重点是在大规模科学应用程序中利用的共同设计过程。关键的研究活动包括建立一个框架来评估不同类别的大数据分析，表征数据分析在绩效和权力方面的应用程序，以及开发一种方法，以构建模型来理解和探索设计空间。随着数据分析应用程序在广泛的领域中变得越来越重要，在广泛的范围内，可以开发大规模的平台，可持续的平台和软件构建范围，以支持这些型号的范围，以支持这些型号和范围。该项目提供了有关大数据分析和未来网络基础结构设计的硬件/软件特征和要求的理解。这些研究活动与研究生和本科生研究融合在一起，并利用Rutgers的少数学生学生外展网络。

项目成果

Runtime Management of Data Quality for Scientific Observatories Using Edge and In-Transit Resources

使用边缘和传输中资源对科学观测站的数据质量进行运行时管理

• DOI: 10.1109/sbac-pad.2018.00053
• 发表时间: 2018
• 期刊: 2018 30th International Symposium on Computer Architecture and High Performance Computing
• 作者: Zamani, Ali Reza;Balouek-Thomert, Daniel;Villalobos, J. J.;Rodero, Ivan;Parashar, Manish
• 通讯作者: Parashar, Manish

Leveraging Renewable Energy in Edge Clouds for Data Stream Analysis in IoT

• DOI: 10.1109/ccgrid.2017.92
• 发表时间: 2017-05
• 期刊: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID)
• 作者: Yunbo Li;Anne-Cécile Orgerie;I. Rodero;M. Parashar;Jean-Marc Menaud

Exploring Power Budget Scheduling Opportunities and Tradeoffs for AMR-based Applications

探索基于 AMR 的应用的功率预算调度机会和权衡

• DOI: 10.1109/sbac-pad.2018.00023
• 发表时间: 2018
• 期刊: 2018 30th International Symposium on Computer Architecture and High Performance Computing
• 作者: Qin, Yubo;Rodero, Ivan;Subedi, Pradeep;Parashar, Manish;Rigo, Sandro
• 通讯作者: Rigo, Sandro

Exploring the Potential of FreeBSD Virtualization in Containerized Environments

探索 FreeBSD 虚拟化在容器化环境中的潜力

• DOI: 10.1145/3147213.3149210
• 发表时间: 2017
• 期刊: Proceedings of the10th International Conference on Utility and Cloud Computing
• 作者: Puig, Francesc-Xavier;Villalobos, J.J.;Rodero, Ivan;Parashar, Manish
• 通讯作者: Parashar, Manish

Exploring the Potential of Next Generation Software-Defined In-Memory Frameworks

探索下一代软件定义内存框架的潜力

• DOI: 10.1109/sbac-pad.2018.00042
• 发表时间: 2018
• 期刊: 2018 30th International Symposium on Computer Architecture and High Performance Computing
• 作者: Chen, Shouwei;Rodero, Ivan
• 通讯作者: Rodero, Ivan