MFC 5.0: An exascale many-physics flow solver

Bibliographic Details
Title: MFC 5.0: An exascale many-physics flow solver
Authors: Wilfong, Benjamin, Berre, Henry A. Le, Radhakrishnan, Anand, Gupta, Ansh, Vaca-Revelo, Diego, Adam, Dimitrios, Yu, Haocheng, Lee, Hyeoksu, Chreim, Jose Rodolfo, Barbosa, Mirelys Carcana, Zhang, Yanjun, Cisneros-Garibay, Esteban, Gnanaskandan, Aswin, Rodriguez Jr., Mauro, Budiardja, Reuben D., Abbott, Stephen, Colonius, Tim, Bryngelson, Spencer H.
Publication Year: 2025
Collection: Computer Science
Physics (Other)
Subject Terms: Physics - Fluid Dynamics, Computer Science - Distributed, Parallel, and Cluster Computing
More Details: Engineering, medicine, and the fundamental sciences broadly rely on flow simulations, making performant computational fluid dynamics solvers an open source software mainstay. A previous work made MFC 3.0 a published open source source solver with many features. MFC 5.0 is a marked update to MFC 3.0, including a broad set of well-established and novel physical models and numerical methods and the introduction of GPU and APU (or superchip) acceleration. We exhibit state-of-the-art performance and ideal scaling on the first two exascale supercomputers, OLCF Frontier and LLNL El Capitan. Combined with MFC's single-GPU/APU performance, MFC achieves exascale computation in practice. With these capabilities, MFC has evolved into a tool for conducting simulations that many engineering challenge problems hinge upon. New physical features include the immersed boundary method, $N$-fluid phase change, Euler--Euler and Euler--Lagrange sub-grid bubble models, fluid-structure interaction, hypo- and hyper-elastic materials, chemically reacting flow, two-material surface tension, and more. Numerical techniques now represent the current state-of-the-art, including general relaxation characteristic boundary conditions, WENO variants, Strang splitting for stiff sub-grid flow features, and low Mach number treatments. Weak scaling to tens of thousands of GPUs on OLCF Frontier and LLNL El Capitan see efficiencies within 5% of ideal to over 90% of their respective system sizes. Strong scaling results for a 16-time increase in device count show parallel efficiencies over 90% on OLCF Frontier. Other MFC improvements include ensuring code resilience and correctness with a continuous integration suite, the use of metaprogramming to reduce code length and maintain performance portability, and efficient computational representations for chemical reactions and thermodynamics via code generation with Pyrometheus.
Comment: 38 pages
Document Type: Working Paper
Access URL: http://arxiv.org/abs/2503.07953
Accession Number: edsarx.2503.07953
Database: arXiv
More Details
Description not available.