ExCALIBUR Hardware and Enabling Software (H&ES): In-situ Visualisation and Unified Programming across Accelerator Architectures at Exascale

ExCALIBUR 硬件和支持软件 (H

• 批准号: ST/W001667/1
• 负责人: Edward Shellard
• 金额: $ 6.42万
• 依托单位: University of Cambridge
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2021
• 资助国家: 英国
• 起止时间: 2021 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=ST%2FW001667%2F1
• 关键词: ExCALIBUR; Hardware; Enabling; Software; H&ES

In 2018, the Exascale Computing ALgorithms & Infrastructures for the Benefit of UK Research (ExCALIBUR) programme was proposed by the Met Office, CCFE and EPSRC (on behalf of UKRI). The goal of ExCALIBUR is to redesign high priority computer codes and algorithms, keeping UK research and development at the forefront of high-performance simulation science. The challenge spans many disciplines and as such the programme of research will be delivered through a partnership between the Met Office and UKRI Research Councils. Research software engineers and scientists will work together to future proof the UK against the fast-moving changes in supercomputer designs. This combined scientific expertise will push the boundaries of science across a wide range of fields delivering transformational change at the cutting-edge of scientific supercomputing. DiRAC proposed the inclusion in the ExCALIBUR business case of a request for £4.5M in capital funding over 4.5 years to develop a hardware fore-sighting programme. Industry co-funding for the programme will be sought where possible. The £4.5m capital is intended to provide a testbed area that uses pre-commercial equipment for software prototyping and development. It has two main purposes: (1) to enable the software community to be ready to use commercial products effectively as soon as they come on to the market; and (2) to provide the UKRI HPC community with the ability to influence industry and the necessary knowledge to guide their purchase decisions. This will ensure that facilities and the future UK National e-Infrastructure are in a position to maximise value for money by getting the most powerful systems exactly suited to the communities' needs. This double-pronged approach will give UK researchers a competitive advantage internationally. ExCALIBUR will now establish a set of modest-sized, adaptable clusters dedicated solely to this purpose and embedded within established HPC environments. Although small, they need to be of a scale capable of carrying out meaningful performance studies. They are expected to be co-funded with industry partners and will initially require investments of £200k-£300k each, and will allow a range of future hardware to be assessed for its relevance to the delivery of UKRI science and innovation. The pre-commercial equipment will be refreshed and added to on a regular, likely to be annual, basis. This agile tactic is designed to take advantage of the different approaches across industry (some companies, e.g. NVidia tend to have a short (less than 3-month) pre-commercial window while for others this can be up to a year).ExCALIBUR can use the hardware piloting systems to drive software innovation across the UKRI research community. Researchers are rightly reluctant to invest time in code development to take advantage of new hardware which may not be available at scale for several years or may even prove not to have longevity - scientific leadership demands that research funding is used to deliver science results now. In addition and DiRAC and others will offer funded RSE effort to support the development work combined with access to novel technologies within modest-sized systems, Excalibur can lower the bar for engaging with the process of software re-engineering and encourage researchers to make the necessary (modest) investments of their time. In some cases, there may also be the potential for some immediate science outputs by exploiting the proof-of-concept systems. Excalibur will thus be able to provide an incentive for greater software innovation across the UKRI research communities and help to ensure that when novel technology is included in national services, there are workflows that are already able to exploit it optimally. This will increase productivity across all UKRI computing services and enable UK researchers to use the latest hardware to deliver the largest and most complex calculations, ensuring international leadership.

2018年，英国气象局、CCFE和EPSRC（代表UKRI）提出了Exascale Computing ALtax ms & Structures for the Benefit of UK Research（ExCALIBUR）计划。ExCALIBUR的目标是重新设计高优先级的计算机代码和算法，使英国的研究和开发处于高性能仿真科学的最前沿。这项挑战跨越了许多学科，因此研究计划将通过英国气象局和UKRI研究委员会之间的伙伴关系提供。研究软件工程师和科学家将共同努力，以证明未来英国对超级计算机设计的快速变化。这种结合的科学专业知识将在广泛的领域推动科学的边界，在科学超级计算的前沿提供转型变革。DiRAC提议在ExCALIBUR商业案例中包括一项在4.5年内获得450万英镑资本资金的请求，以开发一个硬件预见方案。在可能的情况下，将为该方案寻求行业共同供资。这笔450万英镑的资金旨在提供一个测试平台，使用预商用设备进行软件原型设计和开发。它有两个主要目的：（1）使软件社区能够在商业产品上市后立即有效地使用它们;（2）为UKRI HPC社区提供影响行业的能力和指导其购买决策的必要知识。这将确保设施和未来的英国国家电子基础设施能够通过获得最适合社区需求的最强大的系统来实现资金价值的最大化。这种双管齐下的方法将使英国研究人员在国际上具有竞争优势。ExCALIBUR现在将建立一套中等规模的、适应性强的集群，专门用于此目的，并嵌入到已建立的HPC环境中。尽管规模较小，但它们必须具有能够进行有意义的绩效研究的规模。它们预计将与行业合作伙伴共同资助，最初将需要每个20万至30万英镑的投资，并将允许评估一系列未来硬件与UKRI科学和创新交付的相关性。将定期（可能每年）更新和添加预商用设备。这种敏捷策略旨在利用整个行业的不同方法（一些公司，例如NVidia往往有一个很短的（不到3个月）商业前窗口，而其他公司可能长达一年）。ExCALIBUR可以使用硬件试点系统来推动UKRI研究社区的软件创新。研究人员不愿意在代码开发上投入时间，以利用新硬件，这些硬件可能在几年内无法大规模使用，甚至可能被证明没有寿命-科学领导要求研究资金现在就用于交付科学成果。此外，DiRAC和其他人将提供资助的RSE努力，以支持开发工作，并在中等规模的系统中获得新技术，Excalibur可以降低参与软件再工程过程的门槛，并鼓励研究人员进行必要的（适度的）时间投资。在某些情况下，利用概念验证系统也可能产生一些直接的科学产出。因此，Excalibur将能够为UKRI研究社区的更大软件创新提供激励，并有助于确保当新技术被纳入国家服务时，已经有工作流程能够最佳地利用它。这将提高所有UKRI计算服务的生产力，并使英国研究人员能够使用最新的硬件提供最大和最复杂的计算，确保国际领先地位。