MagIC v5.10: a two-dimensional message-passing interface (MPI) distribution for pseudo-spectral magnetohydrodynamics simulations in spherical geometry - INSU - Institut national des sciences de l'Univers Access content directly
Journal Articles Geoscientific Model Development Year : 2021

MagIC v5.10: a two-dimensional message-passing interface (MPI) distribution for pseudo-spectral magnetohydrodynamics simulations in spherical geometry

Rafael Lago
  • Function : Author
Thomas Gastine
Tilman Dannert
  • Function : Author
Markus Rampp
Johannes Wicht

Abstract

We discuss two parallelization schemes for MagIC, an open-source, high-performance, pseudo-spectral code for the numerical solution of the magnetohydrodynamics equations in a rotating spherical shell. MagIC calculates the non-linear terms on a numerical grid in spherical coordinates, while the time step updates are performed on radial grid points with a spherical harmonic representation of the lateral directions. Several transforms are required to switch between the different representations. The established hybrid parallelization of MagIC uses message-passing interface (MPI) distribution in radius and relies on existing fast spherical transforms using OpenMP. Our new two-dimensional MPI decomposition implementation also distributes the latitudes or the azimuthal wavenumbers across the available MPI tasks and compute cores. We discuss several non-trivial algorithmic optimizations and the different data distribution layouts employed by our scheme. In particular, the two-dimensional distribution data layout yields a code that strongly scales well beyond the limit of the current one-dimensional distribution. We also show that the two-dimensional distribution implementation, although not yet fully optimized, can already be faster than the existing finely optimized hybrid parallelization when using many thousands of CPU cores. Our analysis indicates that the two-dimensional distribution variant can be further optimized to also surpass the performance of the one-dimensional distribution for a few thousand cores.
Fichier principal
Vignette du fichier
gmd-14-7477-2021.pdf (3.87 Mo) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Dates and versions

insu-03589772 , version 1 (26-02-2022)

Licence

Attribution

Identifiers

Cite

Rafael Lago, Thomas Gastine, Tilman Dannert, Markus Rampp, Johannes Wicht. MagIC v5.10: a two-dimensional message-passing interface (MPI) distribution for pseudo-spectral magnetohydrodynamics simulations in spherical geometry. Geoscientific Model Development, 2021, 14, pp.7477-7495. ⟨10.5194/gmd-14-7477-2021⟩. ⟨insu-03589772⟩
40 View
21 Download

Altmetric

Share

Gmail Facebook X LinkedIn More