TY - JOUR
T1 - GR-Athena++
T2 - Puncture evolutions on vertex-centered oct-tree adaptive mesh refinement
AU - Daszuta, Boris
AU - Zappa, Francesco
AU - Cook, William
AU - Radice, David
AU - Bernuzzi, Sebastiano
AU - Morozova, Viktoriya
N1 - Publisher Copyright:
© 2021. The American Astronomical Society. All rights reserved.
PY - 2021/12
Y1 - 2021/12
N2 - Numerical relativity is central to the investigation of astrophysical sources in the dynamical and strong-field gravity regime, such as binary black hole and neutron star coalescences. Current challenges set by gravitational-wave and multimessenger astronomy call for highly performant and scalable codes on modern massively parallel architectures. We present GR-Athena++, a general-relativistic, high-order, vertex-centered solver that extends the oct-tree, adaptive mesh refinement capabilities of the astrophysical (radiation) magnetohydrodynamics code Athena++. To simulate dynamical spacetimes, GR-Athena++ uses the Z4c evolution scheme of numerical relativity coupled to the moving puncture gauge. We demonstrate stable and accurate binary black hole merger evolutions via extensive convergence testing, cross-code validation, and verification against state-of-the-art effective-one-body waveforms. GR-Athena++ leverages the task-based parallelism paradigm of Athena++ to achieve excellent scalability. We measure strong-scaling efficiencies above 95% for up to ∼1.2 × 104 CPUs and excellent weak scaling is shown up to ∼105 CPUs in a production binary black hole setup with adaptive mesh refinement. GR-Athena++ thus allows for the robust simulation of compact binary coalescences and offers a viable path toward numerical relativity at exascale.
AB - Numerical relativity is central to the investigation of astrophysical sources in the dynamical and strong-field gravity regime, such as binary black hole and neutron star coalescences. Current challenges set by gravitational-wave and multimessenger astronomy call for highly performant and scalable codes on modern massively parallel architectures. We present GR-Athena++, a general-relativistic, high-order, vertex-centered solver that extends the oct-tree, adaptive mesh refinement capabilities of the astrophysical (radiation) magnetohydrodynamics code Athena++. To simulate dynamical spacetimes, GR-Athena++ uses the Z4c evolution scheme of numerical relativity coupled to the moving puncture gauge. We demonstrate stable and accurate binary black hole merger evolutions via extensive convergence testing, cross-code validation, and verification against state-of-the-art effective-one-body waveforms. GR-Athena++ leverages the task-based parallelism paradigm of Athena++ to achieve excellent scalability. We measure strong-scaling efficiencies above 95% for up to ∼1.2 × 104 CPUs and excellent weak scaling is shown up to ∼105 CPUs in a production binary black hole setup with adaptive mesh refinement. GR-Athena++ thus allows for the robust simulation of compact binary coalescences and offers a viable path toward numerical relativity at exascale.
UR - http://www.scopus.com/inward/record.url?scp=85119999680&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85119999680&partnerID=8YFLogxK
U2 - 10.3847/1538-4365/ac157b
DO - 10.3847/1538-4365/ac157b
M3 - Article
AN - SCOPUS:85119999680
SN - 0067-0049
VL - 257
JO - Astrophysical Journal, Supplement Series
JF - Astrophysical Journal, Supplement Series
IS - 2
M1 - 25
ER -