Automatic code parallelization for data-intensive computing in multicore systems

Automatic code parallelization for data-intensive computing in multicore systems
复制标题

多核系统中数据密集型计算的自动代码并行化

DOI:
10.1088/1742-6596/1411/1/012014
复制
发表时间:
2019
期刊:
Journal of Physics: Conference Series
影响因子:
--
通讯作者:
Zhang, Hui
Zhang, Hui
中科院分区:
--
文献类型:
--
作者:
Subramanian, Ranjini;Zhang, Hui

文献摘要

参考文献

相似文献

数据科学日益流行的一个主要推动力是,在海量复杂数据的推动下,对数据驱动型分析的需求日益增长。并行处理日益成为解决计算量大和数据密集型问题的一种经济高效的方法。许多现有的应用程序本质上是顺序的,如果这些应用程序被移植到多处理器系统来执行,它们将只使用一个核,并且不能保证所有核的最佳使用。要确保使用多处理器系统提供的处理能力以实现更好的性能,并行编程知识是必要的。然而,许多用户不具备将现有的顺序代码转换为并行代码以实现加速和可伸缩性所需的技能和知识。在本文中,我们介绍了一个框架,它自动将现有的顺序代码转换为并行代码,同时使用分而治之的范例确保功能正确,从而使多核系统提供的好处最大化。本文将概述该框架的实现,并通过实际用例演示其用法。
A major driving force behind the increasing popularity of data science is the increasing need for data-driven analytics fuelled by massive amounts of complex data. Increasingly, parallel processing has become a cost-effective method for computationally large and data-intensive problems. Many existing applications are sequential in nature and if such applications are ported to multi-processor systems for execution, they would make use of only one core and the optimal usage of all cores is not guaranteed. Knowledge of parallel programming is necessary to ensure the use of processing power offered by multi-processor systems in order to achieve better performance. However, many users do not possess the skills and knowledge required to convert existing sequential code to parallel code to achieve speedups and scalability. In this paper, we introduce a framework that automatically transforms existing sequential code to parallel code while ensuring functional correctness using divide-and-conquer paradigm, so that the benefits offered by multi-core systems can be maximized. The paper will outline the implementation of the framework and demonstrate its usage with practical use cases.
DOI: 10.1109/bigdata.2018.8622068
发表时间: 2018
期刊: 2018 IEEE International Conference on Big Data (Big Data
影响因子: --
作者:
Subramanian, Ranjini;Zhang, Hui
通讯作者: Zhang, Hui
分而治之算法在矩阵特征值问题中的计算机模拟及应用
DOI: --
发表时间: 2009
期刊: International Conference on Trust Management
影响因子: --
作者:
Yuhuan Cui;Jingguo Qu;Weili Chen;Aimin Yang
通讯作者: Aimin Yang
TextRWeb:在网络上使用 R 进行大规模文本分析
DOI: --
发表时间: 2014
期刊: Extreme Science and Engineering Discovery Environment
影响因子: --
作者:
Guangchen Ruan;Hui Zhang;E. Wernert;Beth Plale
通讯作者: Beth Plale