Cambridge Service for Data Driven Discovery (CSD3) - A National Data Intensive Science Cloud for Converged Simulation, AI & Analytics

CSD3的高层目标有三个：-第一，为EPSRC社区提供一个可访问的、可扩展的和创新的世界级研究设施，80%的系统通过公开的国家呼叫免费提供。这将使EPSRC研究人员的数量和多样性增加，从而利用先进的模拟、数据分析和人工智能能力，显著增加整个EPSRC产品组合中有影响力的科学产出。其次，启动与业界的重大创新合作伙伴关系，研究新兴的艾级技术，反馈给英国-RI高性能计算路线图和科学计划，帮助英国保持在高性能计算和人工智能技术的前沿。第三，积极推动更协调的Tier-2网络，在更广泛的UK-RI Ne-I内部极大地改进垂直整合。为了实现这些目标，该提案建立在我们之前2016年Tier-2提案的成功基础上，剑桥大学(UoC)将其资金与STFC DiRAC和EPSRC Tier-2的资金结合起来，形成英国最大的数据密集型国家HPC服务“CSD3”。到目前为止，CSD3的开放访问二级项目的吞吐量是目前所有二级中心中最大的。这项提案再次利用了大量额外的非EPSRC资金，提供了来自UOC、STFC和行业的144%Match资金。这些重大投资将用于加强EPSRC Tier-2资金，以扩展CSD3的四个关键要素，与现有的CSD3集成，形成显著增强的能力。这些新的服务要素在此简要介绍：1)平台：保留已部署的高度成功的数据密集型异构体系结构，并显著增强其容量：首先，将Intel X86群集从36K核心扩展到72K。其次，利用NVIDIA令人兴奋的下一代GPU将GPU数量从360个增加到720个，创建世界上第一个用于人工智能和模拟的大规模预亿级原型系统之一，但重要的是，使用下一代显卡，速度显著快于当前的V100代。总体而言，仅对于GB 4M，这将使CSD3的EPSRC模拟能力提高4倍，其AI能力提高9倍。2)服务支持：大幅提升用户支持、RSE、培训以及二级管理和外展能力。此外，STFC DiRAC和STFC IRIS CSD3将与N8-CIR、超级计算Wales、STFC DiRAC和STFC IRIS CSD3展开新的合作，与参与美国XSEDE HPC计划的3个关键美国HPC中心合作，共同开发、集成和测试世界领先的软件生态系统，用于分配管理、报告、影响分析和改善联合电子基础设施资源的可访问性。3)可访问性：改进建立在OpenStack上的用户访问层，方法是创建一个通过ISO27001认证的环境来保存敏感数据，实施特定于应用程序的门户以帮助新的学科和用户，并使用TACC开发的网关工具包与示范用户社区一起开发一个以社区为重点的科学门户。4)开放艾斯卡实验室：行业资助和联合资源合作伙伴关系，开展重大创新活动，研究新兴艾斯卡技术，涉及网络、加速器、编程环境、新型存储和文件系统技术。转变英国对新兴HPC技术的获取，为科学计划和UK-RI Ne-I路线图提供支持。因此，这项提议将在4个方面产生重大产出和影响：-1)帮助在大量项目(目标为600个)中提供有影响力的EPSRC科学，并提高英国的工业竞争力2)极大地改善对HPC资源的获取，显著增加对学术和工业用户的培训/提高技能3)通过努力和软件工具极大地增强和协调Tier-2计划；4)通过行业资助的Open Exascale La进行重大技术创新

The high-level aims of CSD3 are threefold:- Firstly, to provide the EPSRC community with an accessible, scalable and innovative world-class research facility, with 80% of the system freely available via an open national call. This will enable an increased quantity and diversity of EPSRC researchers, to exploit advanced simulation, data analytics and AI capability, significantly increasing impactful scientific outputs across the entire EPSRC portfolio. Secondly, to kickstart a significant innovation partnership with industry that will investigate emerging exascale technologies, feeding back into the UK-RI HPC roadmap and science programmes, helping to keep the UK at the forefront of HPC & AI technologies. Thirdly, to pro-actively drive a more coordinated Tier-2 network, with greatly improved vertical integration within wider UK-RI Ne-I.To achieve these aims, the proposal builds on the success our previous 2016 Tier-2 proposal where the University of Cambridge (UoC) combined its funds with those from STFC DiRAC and EPSRC Tier-2 to form "CSD3", the UK's largest data intensive national HPC service. CSD3 has seen by far the largest throughput of open-access Tier-2 projects of all current Tier-2 centers. This proposal again levers significant additional non-EPSRC funding, providing 144% match funding from UoC, STFC and industry. These significant investments will be used to enhance the EPSRC Tier-2 funding to expand four key elements of CSD3, integrated with the existing CSD3 to form a significantly enhanced capability.These new service elements are described briefly here: 1) Platform: Retain the highly successful data intensive heterogeneous architecture already deployed and significantly enhance its capacity: Firstly, growing the Intel X86 cluster from 36K cores to 72K. Secondly, create one of the world's first large-scale pre-exascale prototype systems for AI & simulation with exciting next-generation GPUs from NVIDIA doubling the number of GPUs from 360 to 720 but importantly with next generation cards, significantly faster than the current V100 generation. In total, for just £4M, this will increase the EPSRC simulation capability of CSD3 by 4X and its AI capability by 9X. 2) Service support: Substantially increase the user support, RSE, training and Tier-2 management and outreach capability. Also, in collaboration with N8-CIR, Supercomputing Wales, STFC DiRAC & STFC IRIS CSD3 will initiate a new collaboration with 3 key USA HPC centers involved in the US XSEDE HPC program to co-develop, integrate & test a world-leading software ecosystem for allocation management, reporting, impact analysis and improved accessibility of federated e-Infrastructure resources. 3) Accessibility: Improve the user access layer built on Openstack, by creating an ISO27001 certified environment for holding sensitive data, implementing application-specific portals to aid new disciplines and users and develop with an exemplar user community, a community focused scientific gateway, using the gateway tool kit developed at TACC. 4) Open Exascale Lab: An industry funded and jointly resourced partnership to undertake major innovation activity, investigating emerging exascale technologies, across networking, accelerators, programming environments, novel storage and filesystem technologies. Transforming the UK's access to emerging HPC technologies feeding science programs and UK-RI Ne-I roadmap.Thus this proposal will produce significant outputs and impact in 4 areas:- 1)help to deliver impactful EPSRC science across a large number of projects (targeted at 600) and increase UK industrial competitiveness 2)greatly enhanced access to HPC resources, significantly increase training /upskilling for both academic and industrial users 3)greatly enhance and coordinate Tier-2 programme with effort and software tools; 4)undertake significant technology innovation via industry funded Open Exascale La