Optimal Scheduling of Scientific Application Workflows for Cloud-augmented Grid Infrastructures

云增强网格基础设施科学应用工作流程的优化调度

• 批准号: EP/I034254/1
• 负责人: Stephen Winter
• 金额: $ 7.04万
• 依托单位: University of Westminster
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2011
• 资助国家: 英国
• 起止时间: 2011 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FI034254%2F1
• 关键词: Optimal; Scheduling; Scientific; Application; Workflows

Research scientists need cloud computing to flexibly support their computational requirements but also require user-friendly tools in order to engage. Demanding computational requirements for science research have been addressed through grid computing, which until recently has been based on a fixed physical wide-area infrastructure. Physical grid resources can become overloaded however - scientists may find this restricts their needs where the performance required at a particular moment in time cannot be addressed in real-time. User-friendly tools and environments are required to support grid computing in science communities. P-GRADE is a web-based portal, co-developed and by the investigators, for designing, submitting and monitoring workflows on the grid. It is highly graphical, and thus very appealing to a wide range of non-computing specialists.Familiarity is important to users. In order to develop the potential for cloud computing for the same community of science researchers, it is highly desirable, from their perspective, to retain continuity of computational support environment, as much as possible. The P-GRADE environment has been influenced by user requirements and aspirations over many years, and has already achieved a high degree of acceptance within the research science community, in view of its usability. In any case, to redesign a user interface from scratch is a very costly development activity.Interoperability between service grids and cluster grids was achieved by the investigators in the EU FP7-funded EDGeS project, so that users of each community may now access the resources of the other. Grid computing can also be extended onto cloud resources. The investigators have recently developed solutions for extending both service and cluster grids with virtual cloud resources.The usability of the tools and environment developed for the grid has been experimentally evaluated by the investigators in collaboration with biological research groups at the University of Westminster and Imperial College. These collaborative experiments have been very successful, in that the research biologists have found them very acceptable working environments, and have actively adopted them for their live research programmes. The collaborations have also confirmed that the computational performance of the grid solutions was significantly enhanced. The combined effect of a high degree of usability and enhanced computational performance has been to facilitate significant shifts in biological experimental methodology, leading to increased research productivity.Nevertheless, there are limits to the performance achievable on fixed grid implemented on physical infrastructure, due to the physical limitations of the infrastructure itself. Cloudbursting, ie. the ability to provide additional compute capacity that may be required on demand at specific times to cope with unpredictable peaks of research computing, is an attractive aspect of cloud computing which has the potential to break through the current performance constraints achievable on fixed grids. It is proposed to attach a cloud infrastructure to existing fixed grids to achieve a mixed grid infrastructure comprising both existing physical and virtualised cloud resources. It is then proposed to re-engineer the tools and environment to exploit cloudbursting in the mixed grid to achieve even greater performance. Finally, the performance of the mixed physical/virtual grid will be evaluated, to include statistics on resource utilisation, to inform the development of a costed performance model.

研究科学家需要云计算以灵活地支持其计算要求，但还需要用户友好的工具才能参与。通过网格计算解决了对科学研究的苛刻计算要求，直到最近，该计算一直基于固定的物理大区域基础设施。但是，物理网格资源可能会变得超负荷 - 科学家可能会发现这限制了他们的需求，而在某个特定时间无法实时解决的时刻所需的性能。需要用户友好的工具和环境来支持科学社区的网格计算。 P级是一个基于网络的门户网站，并由研究人员共同开发，用于设计，提交和监视网格上的工作流程。它具有高度的图形性，因此非常吸引着广泛的非计算专家。熟悉对用户很重要。为了开发同一科学研究人员社区云计算的潜力，从他们的角度来看，它是非常希望的，以保持计算支持环境的连续性。多年来，P级环境受到用户需求和愿望的影响，鉴于其可用性，已经在研究科学界获得了高度的接受。无论如何，从头开始重新设计用户界面是一项非常昂贵的开发活动。研究网格和集群网格之间的可互换性是由欧盟FP7资助的边缘项目中的研究人员实现的，因此每个社区的用户现在可以访问其他人的资源。网格计算也可以扩展到云资源。研究人员最近开发了用于通过虚拟云资源扩展服务和集群网格的解决方案。研究人员与威斯敏斯特大学和帝国大学的生物学研究小组合作评估了为电网开发的工具和环境的可用性。这些协作实验非常成功，因为研究生物学家发现它们非常可接受的工作环境，并积极采用了它们的实时研究计划。这些合作还证实，网格解决方案的计算性能得到了显着提高。高度可用性和增强的计算性能的综合作用是促进生物学实验方法的显着转变，从而提高了研究生产力。尽管如此，由于基础设施本身的物理限制，在物理基础设施上实现的固定网格可实现的性能有限制。 Cloudbursting，即。提供额外的计算能力的能力，可能需要在特定时间按需按需应对研究计算的不可预测的峰值，这是云计算的一个有吸引力的方面，有可能破坏在固定网格上可实现的当前性能约束。建议将云基础架构附加到现有的固定网格上，以实现包括现有物理和虚拟化云资源的混合网格基础架构。然后提议重新设计工具和环境，以利用混合网格中的云爆炸，以实现更大的性能。最后，将评估混合物理/虚拟网格的性能，包括有关资源利用的统计信息，以告知成本绩效模型的开发。

项目成果

Buttressing volatile desktop grids with cloud resources within a reconfigurable environment service for workflow orchestration

• DOI: 10.1186/2192-113x-3-1
• 发表时间: 2014-01-01
• 期刊: JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS
• 影响因子: 4
• 作者: Winter, Stephen C.;Reynolds, Christopher J.;Kacsuk, Peter
• 通讯作者: Kacsuk, Peter

Development of user friendly, high throughput screening for ligands and inhibitors of carbohydrate modifying enzymes

开发用户友好的高通量筛选碳水化合物修饰酶的配体和抑制剂

• 期刊: Proc. 2nd glyco-bioinformatics Beilstein-Institut symposium , 27th June - 1st July 2011, Potsdam, Germany
• 作者: Stephen Winter (Co-Author)

Application Repository and Science Gateway for Molecular Docking Simulations

用于分子对接模拟的应用程序存储库和科学网关

• 期刊: 4th International Workshop on Science Gateways for Life Sciences, 23 - 25 May, 2012, Amsterdam, The Netherlands, in conjunction with Healthgrid Conference 2012 and featuring EGI.eu, 2012.
• 作者: Stephen Winter (Co-Author)