High Performance Parallel and Distributed Systems: Resource Management and Data Handling Techniques

本文的研究重点是集群和云等高性能并行分布式系统上的资源管理和数据处理技术。在企业和社交媒体环境以及基于传感器的智能系统(如智能桥梁、建筑、机械和医疗保健系统)中使用的计算和数据密集型BigData分析应用程序通常需要这种高性能环境的强大功能。目前，这类系统的研究人员面临着两个重要的挑战：(I)处理和分析(I)大量存储的数据和(Ii)来自Twitter订阅源和连续生成的传感器数据的流数据。在当今数据和计算密集型系统的背景下，这些都很重要。有效的资源管理和数据处理技术对于为此类系统上的用户实现高性能和高质量的体验至关重要。迫切需要新的具有成本效益的技术来利用云中的底层大型资源池，这些资源池通常用于应对此类数据和计算密集型应用程序的挑战，并及时产生结果。拟议的研究旨在实现这些必要的科学和技术创新。成果与好处：研究成果将在两个重要领域适用于研究人员和用户：(A)基于云的数据分析平台，这对从BigData中提取知识至关重要；(B)智能系统，是新兴智能社会的重要组成部分。研究成果将创造新的知识，提高最先进的技术水平，并有助于为系统用户实现所需的服务质量，为服务提供商提供足够的收入，为公众提供安全和经济维护的基础设施和机器，以及高效的医疗保健系统。对学生的培训是该计划的重要组成部分；研究成果和经过培训的HQP将有助于确立加拿大作为全球市场领导者的地位。多年来，我一直在研究分布式系统和资源管理，最近的重点是云和数据分析平台。我的贡献通过最佳论文奖和IEEE计算机协会杰出访问者的评选而得到认可。我在过去6年的活动体现在我被选为工程技术研究所院士，58次在著名的国际论坛上发表评论文章，4次主旨演讲，1次全体演讲和13次特邀讲座(包括2次教程)，主持了一次国际会议和组织了几次国际研讨会。我的研究与公众的相关性体现在我的媒体采访和我的研究在《科学》杂志上的专题报道中。

The proposed research focuses on resource management and data handling techniques on high performance parallel and distributed systems including clusters and clouds. Computation and data intensive BigData analytics applications used in the context of enterprise and social media as well on sensor-based smart systems (e.g. smart bridges, buildings, machinery and health care systems) often require the power of such high performance environments. There are two important challenges currently facing the researchers of such systems: processing and analysis of (i) large volumes of stored data and (ii) streaming data resulting from twitter feeds and continuously generated sensor data for example. Each of these is important in the context of today's data and computation intensive systems. Effective resource management and data handling techniques are crucial for achieving high performance and high quality of experience for the users on such systems. New cost effective techniques are critically needed for harnessing the underlying large resource pools in clouds that are often used to meet the challenges of such data and computation intensive applications and produce results in a timely manner. Proposed research is directed at achieving these required innovations in science and technology. Outcomes & Benefits: Results of the research will be applicable to both researchers and users in two important domains: (a) cloud based data analytics platforms that are crucial for extracting knowledge from BigData and (b) smart systems that are essential components of the newly emerging smart society. The research results will create new knowledge, advance the state of the art and contribute to the achievement of the desired quality of service for system users, adequate revenues for service providers, safe and economically maintained infrastructures and machinery as well as efficient health care systems for the public. Training of students is an important and an integral part of the plan; the research results and trained HQP will aid in establishing Canada as a leader in the global market. I have been researching distributed systems and resource management for many years with recent focus on clouds and data analytics platforms. My contributions are recognized through best paper awards and selection as a Distinguished Visitor for the IEEE Computer Society. My activities in the past 6 years are reflected in my selection as a Fellow of the Institution of Engineering and Technology, 58 refereed contributions in reputed international forums, 4 keynote addresses, 1 plenary address and 13 invited lectures (including 2 tutorials), chairing of an international conference and the organization of several international workshops. Relevance of my research for the public is captured in my media interviews and the featuring of my research in the Scientia magazine.