Search

High-fidelity direct numerical simulation of turbulent flows for most real-world applications remains an outstanding computational challenge. Several machine learning approaches have recently been proposed to alleviate the computational cost even though they become unstable or unphysical for long time predictions. We identify that the Fourier neural operator (FNO) based models combined with a partial differential equation (PDE) solver can accelerate fluid dynamic simulations and thus address computational expense of large-scale turbulence simulations. We treat the FNO model on the same footing as a PDE solver and answer important questions about the volume and temporal resolution of data required to build pre-trained models for turbulence. We also discuss the pitfalls of purely data-driven approaches that need to be avoided by the machine learning models to become viable and competitive tools for long time simulations of turbulence.

We present our ongoing work aimed at accelerating a particle-resolved direct numerical simulation model designed to study aerosol-cloud-turbulence interactions. The dynamical model consists of two main components - a set of fluid dynamics equations for air velocity, temperature, and humidity, coupled with a set of equations for particle (i.e., cloud droplet) tracing. Rather than attempting to replace the original numerical solution method in its entirety with a machine learning (ML) method, we consider developing a hybrid approach. We exploit the potential of neural operator learning to yield fast and accurate surrogate models and, in this study, develop such surrogates for the velocity and vorticity fields. We discuss results from numerical experiments designed to assess the performance of ML architectures under consideration as well as their suitability for capturing the behavior of relevant dynamical systems.

High-energy physics (HEP) experiments have developed millions of lines of code over decades that are optimized to run on traditional x86 CPU systems. However, we are seeing a rapidly increasing fraction of floating point computing power in leadership-class computing facilities and traditional data centers coming from new accelerator architectures, such as GPUs. HEP experiments are now faced with the untenable prospect of rewriting millions of lines of x86 CPU code, for the increasingly dominant architectures found in these computational accelerators. This task is made more challenging by the architecture-specific languages and APIs promoted by manufacturers such as NVIDIA, Intel and AMD. Producing multiple, architecture-specific implementations is not a viable scenario, given the available person power and code maintenance issues. The Portable Parallelization Strategies team of the HEP Center for Computational Excellence is investigating the use of Kokkos, SYCL, OpenMP, std::execution::parallel and alpaka as potential portability solutions that promise to execute on multiple architectures from the same source code, using representative use cases from major HEP experiments, including the DUNE experiment of the Long Baseline Neutrino Facility, and the ATLAS and CMS experiments of the Large Hadron Collider. This cross-cutting evaluation of portability solutions using real applications will help inform and guide the HEP community when choosing their software and hardware suites for the next generation of experimental frameworks. We present the outcomes of our studies, including performance metrics, porting challenges, API evaluations, and build system integration., Comment: 18 pages, 9 Figures, 2 Tables

The evolution of the computing landscape has resulted in the proliferation of diverse hardware architectures, with different flavors of GPUs and other compute accelerators becoming more widely available. To facilitate the efficient use of these architectures in a heterogeneous computing environment, several programming models are available to enable portability and performance across different computing systems, such as Kokkos, SYCL, OpenMP and others. As part of the High Energy Physics Center for Computational Excellence (HEP-CCE) project, we investigate if and how these different programming models may be suitable for experimental HEP workflows through a few representative use cases. One of such use cases is the Liquid Argon Time Projection Chamber (LArTPC) simulation which is essential for LArTPC detector design, validation and data analysis. Following up on our previous investigations of using Kokkos to port LArTPC simulation in the Wire-Cell Toolkit (WCT) to GPUs, we have explored OpenMP and SYCL as potential portable programming models for WCT, with the goal to make diverse computing resources accessible to the LArTPC simulations. In this work, we describe how we utilize relevant features of OpenMP and SYCL for the LArTPC simulation module in WCT. We also show performance benchmark results on multi-core CPUs, NVIDIA and AMD GPUs for both the OpenMP and the SYCL implementations. Comparisons with different compilers will also be given where appropriate., Comment: 6 pages, 6 figures. Proceedings of 21st International Workshop on Advanced Computing and Analysis Techniques in Physics Research (ACAT 2022)

A Taylor-Couette setup with radial heating is considered where a Boussinesq fluid is sheared in the annular region between two concentric, independently rotating cylinders maintained at different temperatures. Linear stability analysis is performed to determine the Taylor number for the onset of instability. Two radius ratios corresponding to wide and thin gaps with several rotation rate ratios are considered. The rotation of the outer cylinder is found to have a general stabilizing effect on the stability threshold as compared to pure inner-cylinder rotation, with a few exceptions. The radial heating sets up an axial flow which breaks the reflection symmetry of isothermal Taylor-Couette flow in the axial coordinate. This symmetry breaking separates linear stability thresholds and we find fastest growing modes with both positive and negative azimuthal numbers for different parameters. Another important finding of the current study is the discovery of unstable modes in the Rayleigh-stable regime. Furthermore, closed disconnected neutral curves (CDNCs) are observed for both wide and thin gaps which can separate from or merge into open neutral-stability curves. Alternatively, CDNCs can also morph into open neutral stability curves as the rotation rate ratio is changed. CDNCs are observed to be sensitive to changes in control parameters and their appearance/disappearance is shown to induce discontinuous jumps in the critical Taylor number. For both wide and thin gaps, the fastest-growing modes found in the pure corotation case are shown to have their origins in the instability islands at smaller values of rotation rate ratios., Comment: 18 pages, 16 figures

We present a detailed description of the essentially entropic lattice Boltzmann model. The entropic lattice Boltzmann model guarantees unconditional numerical stability by iteratively solving the nonlinear entropy evolution equation. In this paper we explain the construction of closed-form analytic solutions to this equation. We demonstrate that near equilibrium this exact solution reduces to the standard lattice Boltzmann model. We consider a few test cases to show that the exact solution does not exhibit any significant deviation from the iterative solution. We also extend the analytical solution for the ES-BGK model to remove the limitation on the Prandtl number for heat transfer problems. The simplicity of the exact solution removes the computational overhead and algorithmic complexity associated with the entropic lattice Boltzmann models.

Kinetic models of polyatomic gas typically account for the internal degrees of freedom at the level of the two-particle distribution function. However, close to the hydrodynamic limit, the internal (rotational) degrees of freedom tend to be well represented just by rotational kinetic energy density. We account for the rotational energy by augmenting the Ellipsoidal-statistical BGK (ES-BGK) model, an extension of the Bhatnagar-Gross- Krook (BGK) model, at the level of the single-particle distribution function with an advection-diffusion-relaxation equation for the rotational energy. This reduced model respects the H theorem and recovers the compressible hydrodynamics for polyatomic gases as its macroscopic limit. As required for a polyatomic gas model, this extension of the ES-BGK model has not only correct specific heat ratio but also allows for three independent tunable transport coefficients: thermal conductivity, shear viscosity, and bulk viscosity. We illustrate the effectiveness of the model via a lattice Boltzmann method implementation.

We present an energy conserving lattice Boltzmann model based on a crystallographic lattice for simulation of weakly compressible flows. The theoretical requirements and the methodology to construct such a model are discussed. We demonstrate that the model recovers the isentropic sound speed in addition to the effects of viscous heating and heat flux dynamics. Several test cases for acoustics, thermal and thermoacoustic flows are simulated to show the accuracy of the proposed model.