Cambridge Service for Data Driven Discovery (CSD3) - A National Data Intensive Science Cloud for Converged Simulation, AI & Analytics

剑桥数据驱动发现服务 (CSD3) - 用于融合模拟、人工智能的国家数据密集型科学云

• 批准号: EP/T022159/1
• 负责人: Paul Alexander
• 金额: $ 659.28万
• 依托单位: University of Cambridge
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2020
• 资助国家: 英国
• 起止时间: 2020 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FT022159%2F1
• 关键词: Cambridge; Service; Data; Driven; Discovery

The high-level aims of CSD3 are threefold:- Firstly, to provide the EPSRC community with an accessible, scalable and innovative world-class research facility, with 80% of the system freely available via an open national call. This will enable an increased quantity and diversity of EPSRC researchers, to exploit advanced simulation, data analytics and AI capability, significantly increasing impactful scientific outputs across the entire EPSRC portfolio. Secondly, to kickstart a significant innovation partnership with industry that will investigate emerging exascale technologies, feeding back into the UK-RI HPC roadmap and science programmes, helping to keep the UK at the forefront of HPC & AI technologies. Thirdly, to pro-actively drive a more coordinated Tier-2 network, with greatly improved vertical integration within wider UK-RI Ne-I.To achieve these aims, the proposal builds on the success our previous 2016 Tier-2 proposal where the University of Cambridge (UoC) combined its funds with those from STFC DiRAC and EPSRC Tier-2 to form "CSD3", the UK's largest data intensive national HPC service. CSD3 has seen by far the largest throughput of open-access Tier-2 projects of all current Tier-2 centers. This proposal again levers significant additional non-EPSRC funding, providing 144% match funding from UoC, STFC and industry. These significant investments will be used to enhance the EPSRC Tier-2 funding to expand four key elements of CSD3, integrated with the existing CSD3 to form a significantly enhanced capability.These new service elements are described briefly here: 1) Platform: Retain the highly successful data intensive heterogeneous architecture already deployed and significantly enhance its capacity: Firstly, growing the Intel X86 cluster from 36K cores to 72K. Secondly, create one of the world's first large-scale pre-exascale prototype systems for AI & simulation with exciting next-generation GPUs from NVIDIA doubling the number of GPUs from 360 to 720 but importantly with next generation cards, significantly faster than the current V100 generation. In total, for just £4M, this will increase the EPSRC simulation capability of CSD3 by 4X and its AI capability by 9X. 2) Service support: Substantially increase the user support, RSE, training and Tier-2 management and outreach capability. Also, in collaboration with N8-CIR, Supercomputing Wales, STFC DiRAC & STFC IRIS CSD3 will initiate a new collaboration with 3 key USA HPC centers involved in the US XSEDE HPC program to co-develop, integrate & test a world-leading software ecosystem for allocation management, reporting, impact analysis and improved accessibility of federated e-Infrastructure resources. 3) Accessibility: Improve the user access layer built on Openstack, by creating an ISO27001 certified environment for holding sensitive data, implementing application-specific portals to aid new disciplines and users and develop with an exemplar user community, a community focused scientific gateway, using the gateway tool kit developed at TACC. 4) Open Exascale Lab: An industry funded and jointly resourced partnership to undertake major innovation activity, investigating emerging exascale technologies, across networking, accelerators, programming environments, novel storage and filesystem technologies. Transforming the UK's access to emerging HPC technologies feeding science programs and UK-RI Ne-I roadmap.Thus this proposal will produce significant outputs and impact in 4 areas:- 1)help to deliver impactful EPSRC science across a large number of projects (targeted at 600) and increase UK industrial competitiveness 2)greatly enhanced access to HPC resources, significantly increase training /upskilling for both academic and industrial users 3)greatly enhance and coordinate Tier-2 programme with effort and software tools; 4)undertake significant technology innovation via industry funded Open Exascale La

CSD 3的高层次目标有三个方面：第一，为EPSRC社区提供一个可访问的，可扩展的和创新的世界级研究设施，该系统的80%通过公开的国家电话免费提供。这将使EPSRC研究人员的数量和多样性增加，以利用先进的模拟，数据分析和人工智能能力，显着增加整个EPSRC产品组合的有影响力的科学产出。 第二，与行业建立重要的创新合作伙伴关系，研究新兴的亿亿次技术，反馈到UK-RI HPC路线图和科学计划中，帮助英国保持HPC和AI技术的前沿。 第三，积极推动更加协调的二级网络，大大改善更广泛的UK-RI Ne-I内的垂直整合。为了实现这些目标，该提案建立在我们之前2016年二级提案的成功基础上，其中剑桥大学（UoC）将其资金与STFC DiRAC和EPSRC Tier-2的资金结合起来，形成“CSD 3”，英国最大的数据密集型国家HPC服务。到目前为止，CSD 3已经看到了所有当前Tier-2中心的开放获取Tier-2项目的最大吞吐量。该提案再次利用了大量额外的非EPSRC资金，从UoC，STFC和行业提供了144%的匹配资金。这些重大投资将用于增强EPSRC Tier-2资金，以扩展CSD 3的四个关键要素，与现有CSD 3集成，形成显著增强的能力。这些新的服务要素简要描述如下：1）平台：保留已部署的非常成功的数据密集型异构体系结构，并显著增强其能力：首先，将Intel X86集群从36 K核心扩展到72 K。其次，利用NVIDIA令人兴奋的下一代GPU（将GPU数量从360个增加到720个）创建世界上首个用于人工智能和仿真的大规模前艾级原型系统之一，更重要的是，它采用了比当前V100代快得多的下一代显卡。总的来说，只需400万英镑，这将使CSD 3的EPSRC仿真能力提高4倍，AI能力提高9倍。2)服务支持：大幅增加用户支持、RSE、培训和第2级管理及外联能力。此外，与N8-CIR、Supercomputing Wales、STFC DiRAC和STFC IRIS CSD 3合作，将与参与美国XSEDE HPC计划的3个主要美国HPC中心开展新的合作，共同开发、集成和测试世界领先的软件生态系统，用于分配管理、报告、影响分析和改善联合电子基础设施资源的可访问性。3)无障碍通道：通过创建一个ISO27001认证的环境来保存敏感数据，实施特定于应用程序的门户来帮助新学科和用户，并使用TACC开发的网关工具包，开发一个示范用户社区，一个以社区为中心的科学网关，从而改进基于Openstack构建的用户访问层。4)打开Exascale实验室：一个由行业资助并共同提供资源的合作伙伴关系，以开展重大创新活动，研究新兴的兆兆级技术，涵盖网络、加速器、编程环境、新型存储和文件系统技术。改变英国对新兴HPC技术的访问，为科学计划和UK-RI Ne-I路线图提供支持。因此，该提案将在4个领域产生重大产出和影响：- 1）帮助在大量项目中提供有影响力的EPSRC科学（目标为600）并提高英国的工业竞争力2）大大增强了对HPC资源的访问，大大增加了学术和工业用户的培训/技能提升3）通过努力和软件工具大大增强和协调Tier-2计划; 4）通过行业资助的开放Exascale La进行重大技术创新