Elements:Collaborative Proposal: A task-based code for multiphysics problems in astrophysics at exascale

要素：协作提案：基于任务的亿亿级天体物理学多物理问题代码

• 批准号: 1931266
• 负责人: Mark Scheel
• 金额: $ 29.5万
• 依托单位: California Institute of Technology
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2022-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1931266&HistoricalAwards=false
• 关键词: Elements; Collaborative; Proposal; task; based

Upcoming computers will run at exascale, over a hundred times more powerful than typical machines of today. Many algorithms used in current codes will not be able to take advantage of these new machines. The researchers will complete the development of an open-source community code for multi-scale, multi-physics problems in astrophysics and gravitational physics. The code uses transformative algorithms to reach the exascale. The techniques can be applied across discipline boundaries in fluid dynamics, geoscience, plasma physics and nuclear physics and engineering. The development of this new code has been driven by the current deployment of gravitational wave detectors such as LIGO. To fully understand and analyze the signals and waveforms measured with such detectors, it is essential that accurate, robust, and efficient computational tools be available for solving the dynamical Einstein equations over very long time scales. The recent detection of the merger of a neutron star-neutron star merger by LIGO and by a host of electromagnetic telescopes has ushered The extreme energy densities of matter and radiation and the highly dynamic spacetimes of these events probe fundamental physics inaccessible to terrestrial experiments. The new code will be made available as open-source community cyberinfrastructure. The researchers will reach out to other communities within astrophysics (e.g., star formation, space plasma physics) and across discipline boundaries to fluid dynamics, geoscience, plasma physics, nuclear engineering etc. Early-career researchers trained in these techniques are in great demand, both in academia and as highly-skilled members of the industrial STEM workforce. Undergraduates will participate in the research by producing visualizations.The new code uses discontinuous Galerkin methods and task-based parallelism to accomplish its desired goals. This framework will allow the multiphysics applications to be treated both accurately and efficiently on the new architectures of petascale and exascale machines. The code is designed to scale to over a million cores for efficient exploration of the parameter space of potential sources and allowed physics, and for the high-fidelity predictions needed to realize the promise of multi-messenger astrophysics. The code will allow astrophysicists to explore the mechanisms driving core-collapse supernovae and the properties of stellar remnants, to understand electromagnetic transients and gravitational-wave phenomena in compact objects, and to reveal the dense matter equation of state. The two key algorithmic innovations in the code, the discontinuous Galerkin method coupled with task-based parallelism, promise revolutionary impact in other fields relying on numerical solution of partial differential equations at the exascale.This project advances the objectives of "Windows on the Universe: the Era of Multi-Messenger Astrophysics", one of the 10 Big Ideas for Future NSF Investments. This project advances also the objectives of the National Strategic Computing Initiative (NSCI), an effort aimed at sustaining and enhancing the U.S. scientific, technological, and economic leadership position in High-Performance Computing (HPC) research, development, and deployment. This project is supported by the Office of Advanced Cyberinfrastructure in the Directorate for Computer & Information Science & Engineering and the Division of Physics and the Division of Astronomical Sciences in the Directorate of Mathematical and Physical Sciences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

即将到来的计算机将运行在艾级，比今天的典型机器强大一百倍以上。当前代码中使用的许多算法将无法利用这些新机器。研究人员将完成一个开源社区代码的开发，用于天体物理学和引力物理学中的多尺度，多物理问题。该代码使用转换算法来达到exascale。这些技术可以应用于流体动力学、地球科学、等离子体物理和核物理与工程等学科的边界。这种新代码的开发是由LIGO等引力波探测器的当前部署推动的。为了充分理解和分析用这种探测器测量的信号和波形，必须有精确、鲁棒和有效的计算工具来求解很长时间尺度上的动态爱因斯坦方程。 最近LIGO和许多电磁望远镜对中子星-中子星星合并的探测迎来了物质和辐射的极端能量密度以及这些事件的高度动态时空探测了地球实验无法达到的基础物理。 新代码将作为开源社区网络基础设施提供。 研究人员将接触天体物理学领域的其他社区（例如，星星形成、空间等离子体物理学）和跨学科边界到流体动力学、地球科学、等离子体物理学、核工程等。在这些技术方面受过培训的早期职业研究人员需求量很大，无论是在学术界还是作为工业STEM劳动力的高技能成员。本科生将通过制作可视化来参与研究。新代码使用不连续Galerkin方法和基于任务的并行性来实现其预期目标。这个框架将允许多物理场应用程序被准确和有效地处理在新架构的千万亿次和亿次机器上。该代码旨在扩展到超过100万个核心，以有效探索潜在源的参数空间和允许的物理学，以及实现多信使天体物理学所需的高保真预测。该代码将允许天体物理学家探索驱动核心坍缩超新星的机制和恒星残骸的性质，了解紧凑物体中的电磁瞬变和引力波现象，并揭示致密物质状态方程。 该代码中的两个关键算法创新，即不连续Galerkin方法和基于任务的并行性，有望在依赖于艾级偏微分方程数值解的其他领域产生革命性影响。该项目推进了“宇宙之窗：多信使天体物理学时代”的目标，这是NSF未来投资的10大想法之一。该项目还推进了国家战略计算计划（NSCI）的目标，该计划旨在维持和加强美国在高性能计算（HPC）研究，开发和部署方面的科学，技术和经济领导地位。该项目由计算机信息科学工程局高级网络基础设施办公室和数学与物理科学局物理学部和天文学部支持。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Improved Cauchy-characteristic evolution system for high-precision numerical relativity waveforms

• DOI: 10.1103/physrevd.102.044052
• 发表时间: 2020-07
• 期刊: Physical Review D
• 影响因子: 5
• 作者: Jordan Moxon;M. Scheel;S. Teukolsky

Fixing the BMS frame of numerical relativity waveforms

修复数值相对论波形的 BMS 框架

• DOI: 10.1103/physrevd.104.024051
• 发表时间: 2021
• 期刊: Physical Review D
• 影响因子: 5
• 作者: Mitman, Keefe;Khera, Neev;Iozzo, Dante A. B.;Stein, Leo C.;Boyle, Michael;Deppe, Nils;Kidder, Lawrence E.;Moxon, Jordan;Pfeiffer, Harald P.;Scheel, Mark A.
• 通讯作者: Scheel, Mark A.

Adding Gravitational Memory to Waveform Catalogs using BMS Balance Laws

使用 BMS 平衡定律将重力记忆添加到波形目录

• 发表时间: 2021
• 期刊: Physical review
• 作者: Mitman, K.;Iozzo, D.;Khera, N.;Boyle, M.;De Lorenzo, T.;Deppe, N.;Kidder, L. E.;Moxon, J.;Pfeiffer, H. J.;Scheel, M. A.
• 通讯作者: Scheel, M. A.

Simulating magnetized neutron stars with discontinuous Galerkin methods

• DOI: 10.1103/physrevd.105.123031
• 发表时间: 2021-09
• 作者: N. Deppe;F. H'ebert;Lawrence E. Kidder;William Throwe;Isha Anantpurkar;C. Armaza;G. Bonilla;M. Boyle;H. Chaudhary;Matthew D. Duez;Nils L. Vu;F. Foucart;M. Giesler;Jason S. Guo;Yoonsoo Kim;Prayush Kumar;I. Legred;Dongjun Li;G. Lovelace;Sizheng Ma;A. Macedo;D. Melchor;M. Morales;Jordan Moxon;Kyle C. Nelli;É. O’Shea;H. Pfeiffer;T. Ramirez;H. Ruter;Jennifer A. Sanchez;M. Scheel;Sierra Thomas;D. Vieira;Nikolas A. Wittek;T. Włodarczyk;S. Teukolsky

Gravitational-wave echoes from numerical-relativity waveforms via spacetime construction near merging compact objects

• DOI: 10.1103/physrevd.105.104007
• 发表时间: 2022-03
• 期刊: Physical Review D
• 影响因子: 5
• 作者: Sizheng Ma;Qingwen Wang;N. Deppe;F. H'ebert;Lawrence E. Kidder;Jordan Moxon;William Throwe;Nils L. Vu;M. Scheel;Yanbei Chen