Heterogeneous Parallel and Distributed Computing with Java (HPDCJ)

使用 Java 进行异构并行和分布式计算 (HPDCJ)

• 批准号: EP/M015750/1
• 负责人: Dimitrios Nikolopoulos
• 金额: $ 28.24万
• 依托单位: Queen's University Belfast
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2015
• 资助国家: 英国
• 起止时间: 2015 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FM015750%2F1
• 关键词: Heterogeneous; Parallel; Distributed; Computing; Java

Our proposal focuses on the ease of use and programmability of Java for distributed heterogeneous computing in order to make it exploitable by the huge user base of mainstream computing. Based on previous work (PCJ library http://pcj.icm.edu.pl), we will introduce and transparently expose parallelism in Java, with minimal change to the specifics of the language, thus allowing programmers to focus on the application. We have demonstrated power and scalability of the PCJ library for the parallel systems and we will extend it for the cases where communication cost and latency could be higher.We will extend the existing solution with the capability of running on the heterogeneous systems including GPU and mobile devices. The user will obtain the possibility to execute computational intensive parts of the application on multiple GPUs. Since our solution is based on Java it can be easily run on mobile devices. Within the project we will extend the library capabilities with the optimised communication and scheduling mechanism necessary to fully use such devices.We will utilise the potential of the parallel Java library to process distributed data. The existing solution benefits from the parallel I/O performed by the multiple JVMs. We will use this solution to optimise the process of data distribution and storage including streaming of the large data sets.We will address dependability and resilience by adding fault tolerance mechanisms to the parallel Java library including fault detection and rescheduling of the application execution. The mechanism will extend capabilities of the existing PCJ library and will be transparent to the users.We will show the applicability of our framework for distributed heterogeneous systems by a set of selected, key applications including data-intensive Big Data applications.Our potential success will create a solution for Java programming that will be very attractive to a wide mainstream user base and will thus have a game-changing influence on the European computing industry.We assembled a carefully selected team with complementary focuses and the right degree of overlap. Most of the partners have worked in close collaboration in previous (EU) projects with remarkable success. We believe this to become a key pilot project that can open the way for future research, which will have a profound impact on mainstream computing.

我们的建议侧重于Java在分布式异构计算中的易用性和可编程性，以使其能够被主流计算的庞大用户群所利用。基于以前的工作（PCJ库http://pcj.icm.edu.pl），我们将引入并透明地公开Java中的并行性，对语言的细节进行最小的更改，从而使程序员能够专注于应用程序。我们已经展示了PCJ库在并行系统中的强大功能和可伸缩性，我们将对其进行扩展，以应对通信成本和延迟可能更高的情况。我们将扩展现有的解决方案，使其能够在包括GPU和移动设备在内的异构系统上运行。用户将获得在多个gpu上执行应用程序的计算密集型部分的可能性。因为我们的解决方案是基于Java的，所以它可以很容易地在移动设备上运行。在项目中，我们将通过优化通信和调度机制来扩展图书馆的功能，以充分利用这些设备。我们将利用并行Java库的潜力来处理分布式数据。现有的解决方案得益于多个jvm执行的并行I/O。我们将使用这个解决方案来优化数据分发和存储的过程，包括大型数据集的流。我们将通过向并行Java库添加容错机制（包括故障检测和应用程序执行的重新调度）来解决可靠性和弹性问题。该机制将扩展现有PCJ库的功能，并且对用户是透明的。我们将通过一组选定的关键应用（包括数据密集型大数据应用）来展示我们的框架对分布式异构系统的适用性。我们潜在的成功将为Java编程创建一个解决方案，它将对广泛的主流用户群非常有吸引力，从而将对欧洲计算行业产生改变游戏规则的影响。我们组建了一个精心挑选的团队，重点互补，重叠程度适当。大多数合作伙伴在以前的（欧盟）项目中密切合作，取得了显著的成功。我们相信这将成为一个关键的试点项目，可以为未来的研究开辟道路，这将对主流计算产生深远的影响。

项目成果

On the Virtualization of CUDA Based GPU Remoting on ARM and X86 Machines in the GVirtuS Framework

GVirtuS框架下ARM和X86机器上基于CUDA的GPU远程虚拟化

• DOI: 10.1007/s10766-016-0462-1
• 发表时间: 2016
• 期刊: International Journal of Parallel Programming
• 影响因子: 1.5
• 作者: Montella R

Heterogeneous Servers based on Programmable Cores and Dataflow Engines

基于可编程内核和数据流引擎的异构服务器

• 发表时间: 2017
• 作者: Yun Wu

HPTA: High-performance text analytics

• DOI: 10.1109/bigdata.2016.7840632
• 发表时间: 2016-12
• 期刊: 2016 IEEE International Conference on Big Data (Big Data)
• 作者: Hans Vandierendonck;Karen L. Murphy;Mahwish Arif;Dimitrios S. Nikolopoulos

The VINEYARD project: Versatile integrated accelerator-based heterogeneous data centres

VINEYARD 项目：基于加速器的多功能集成异构数据中心

• DOI: 10.1109/mocast.2016.7495121
• 发表时间: 2016
• 作者: Kachris C

Applied Reconfigurable Computing - 12th International Symposium, ARC 2016 Mangaratiba, RJ, Brazil, March 22-24, 2016 Proceedings

应用可重构计算 - 第 12 届国际研讨会，ARC 2016，巴西 RJ 曼加拉蒂巴，2016 年 3 月 22-24 日会议记录

• DOI: 10.1007/978-3-319-30481-6_1
• 发表时间: 2016
• 作者: Kachris C