Search

Training deep neural networks is a challenging task. In order to speed up training and enhance the performance of deep neural networks, we rectify the vanilla conjugate gradient as conjugate-gradient-like and incorporate it into the generic Adam, and thus propose a new optimization algorithm named CG-like-Adam for deep learning. Specifically, both the first-order and the second-order moment estimation of generic Adam are replaced by the conjugate-gradient-like. Convergence analysis handles the cases where the exponential moving average coefficient of the first-order moment estimation is constant and the first-order moment estimation is unbiased. Numerical experiments show the superiority of the proposed algorithm based on the CIFAR10/100 dataset., Comment: 32 pages, 13 figures

We develop a Macroscopic Auxiliary Asymptotic-Preserving Neural Network (MA-APNN) method to solve the time-dependent linear radiative transfer equations (LRTEs), which have a multi-scale nature and high dimensionality. To achieve this, we utilize the Physics-Informed Neural Networks (PINNs) framework and design a new adaptive exponentially weighted Asymptotic-Preserving (AP) loss function, which incorporates the macroscopic auxiliary equation that is derived from the original transfer equation directly and explicitly contains the information of the diffusion limit equation. Thus, as the scale parameter tends to zero, the loss function gradually transitions from the transport state to the diffusion limit state. In addition, the initial data, boundary conditions, and conservation laws serve as the regularization terms for the loss. We present several numerical examples to demonstrate the effectiveness of MA-APNNs., Comment: 24 pages, 29 figures

Few-shot learning for image classification comes up as a hot topic in computer vision, which aims at fast learning from a limited number of labeled images and generalize over the new tasks. In this paper, motivated by the idea of Fisher Score, we propose a Discriminative Local Descriptors Attention (DLDA) model that adaptively selects the representative local descriptors and does not introduce any additional parameters, while most of the existing local descriptors based methods utilize the neural networks that inevitably involve the tedious parameter tuning. Moreover, we modify the traditional $k$-NN classification model by adjusting the weights of the $k$ nearest neighbors according to their distances from the query point. Experiments on four benchmark datasets show that our method not only achieves higher accuracy compared with the state-of-art approaches for few-shot learning, but also possesses lower sensitivity to the choices of $k$.

We propose a model-data asymptotic-preserving neural network(MD-APNN) method to solve the nonlinear gray radiative transfer equations(GRTEs). The system is challenging to be simulated with both the traditional numerical schemes and the vanilla physics-informed neural networks(PINNs) due to the multiscale characteristics. Under the framework of PINNs, we employ a micro-macro decomposition technique to construct a new asymptotic-preserving(AP) loss function, which includes the residual of the governing equations in the micro-macro coupled form, the initial and boundary conditions with additional diffusion limit information, the conservation laws, and a few labeled data. A convergence analysis is performed for the proposed method, and a number of numerical examples are presented to illustrate the efficiency of MD-APNNs, and particularly, the importance of the AP property in the neural networks for the diffusion dominating problems. The numerical results indicate that MD-APNNs lead to a better performance than APNNs or pure data-driven networks in the simulation of the nonlinear non-stationary GRTEs.

Based on the perfectly matched layer (PML) technique, this paper develops a high-accuracy boundary integral equation (BIE) solver for acoustic scattering problems in locally defected layered media in both two and three dimensions. The original scattering problem is truncated onto a bounded domain by the PML. Assuming the vanishing of the scattered field on the PML boundary, we derive BIEs on local defects only in terms of using PML-transformed free-space Green's function, and the four standard integral operators: single-layer, double-layer, transpose of double-layer, and hyper-singular boundary integral operators. The hyper-singular integral operator is transformed into a combination of weakly-singular integral operators and tangential derivatives. We develop a high-order Chebyshev-based rectangular-polar singular-integration solver to discretize all weakly-singular integrals. Numerical experiments for both two- and three-dimensional problems are carried out to demonstrate the accuracy and efficiency of the proposed solver., Comment: 19 pages, 16 figures

In this paper, we propose a stochastic Gauss-Newton (SGN) algorithm to study the online principal component analysis (OPCA) problem, which is formulated by using the symmetric low-rank product (SLRP) model for dominant eigenspace calculation. Compared with existing OPCA solvers, SGN is of improved robustness with respect to the varying input data and algorithm parameters. In addition, turning to an evaluation of data stream based on approximated objective functions, we develop a new adaptive stepsize strategy for SGN (AdaSGN) which requires no priori knowledge of the input data, and numerically illustrate its comparable performance with SGN adopting the manaully-tuned diminishing stepsize. Without assuming the eigengap to be positive, we also establish the global and optimal convergence rate of SGN with the specified stepsize using the diffusion approximation theory., Comment: 31 pages, 11 figures

In this paper, we propose and analyze a fully discrete finite element projection method for the magnetohydrodynamic (MHD) equations. A modified Crank--Nicolson method and the Galerkin finite element method are used to discretize the model in time and space, respectively, and appropriate semi-implicit treatments are applied to the fluid convection term and two coupling terms. These semi-implicit approximations result in a linear system with variable coefficients for which the unique solvability can be proved theoretically. In addition, we use a second-order decoupling projection method of the Van Kan type \cite{vankan1986} in the Stokes solver, which computes the intermediate velocity field based on the gradient of the pressure from the previous time level, and enforces the incompressibility constraint via the Helmholtz decomposition of the intermediate velocity field. The energy stability of the scheme is theoretically proved, in which the decoupled Stokes solver needs to be analyzed in details. Error estimates are proved in the discrete $L^\infty(0,T;L^2)$ norm for the proposed decoupled finite element projection scheme. Numerical examples are provided to illustrate the theoretical results., Comment: arXiv admin note: substantial text overlap with arXiv:2011.14511

In our previous work [SIAM J. Sci. Comput. 43(3) (2021) B784-B810], an accurate hyper-singular boundary integral equation method for dynamic poroelasticity in two dimensions has been developed. This work is devoted to studying the more complex and difficult three-dimensional problems with Neumann boundary condition and both the direct and indirect methods are adopted to construct combined boundary integral equations. The strongly-singular and hyper-singular integral operators are reformulated into compositions of weakly-singular integral operators and tangential-derivative operators, which allow us to prove the jump relations associated with the poroelastic layer potentials and boundary integral operators in a simple manner. Relying on both the investigated spectral properties of the strongly-singular operators, which indicate that the corresponding eigenvalues accumulate at three points whose values are only dependent on two Lam\'e constants, and the spectral properties of the Calder\'on relations of the poroelasticity, we propose low-GMRES-iteration regularized integral equations. Numerical examples are presented to demonstrate the accuracy and efficiency of the proposed methodology by means of a Chebyshev-based rectangular-polar solver.

The Calder\'on formulas (i.e., the combination of single-layer and hyper-singular boundary integral operators) have been widely utilized in the process of constructing valid boundary integral equation systems which could possess highly favorable spectral properties. This work is devoted to studying the theoretical properties of elastodynamic Calder\'on formulas which provide us with a solid basis for the design of fast boundary integral equation methods solving elastic wave problems defined on a close-surface or an open-surface in two dimensions. For the closed-surface case, it is proved that the Calder\'on formula is a Fredholm operator of second-kind except for certain circumstances. Regarding to the open-surface case, we investigate weighted integral operators instead of the original integral operators which are resulted from dealing with edge singularities of potentials corresponding to the elastic scattering problems by open-surfaces, and show that the Calder\'on formula is a compact perturbation of a bounded and invertible operator. To complete the proof, we need to use the well-posedness result of the elastic scattering problem, the analysis of the zero-frequency integral operators defined on the straight arc, the singularity decompositions of the kernels of integral operators, and a new representation formula of the hyper-singular operator. Moreover, it can be demonstrated that the accumulation point of the spectrum of the invertible operator is the same as that of the eigenvalues of the Calder\'on formula in the closed-surface case.

In this paper, we propose and analyze a temporally second-order accurate, fully discrete finite element method for the magnetohydrodynamic (MHD) equations. A modified Crank--Nicolson method is used to discretize the model and appropriate semi-implicit treatments are applied to the fluid convection term and two coupling terms. These semi-implicit approximations result in a linear system with variable coefficients for which the unique solvability can be proved theoretically. In addition, we use a decoupling projection method of the Van Kan type \cite{vankan1986} in the Stokes solver, which computes the intermediate velocity field based on the gradient of the pressure from the previous time level, and enforces the incompressibility constraint via the Helmholtz decomposition of the intermediate velocity field. The energy stability of the scheme is theoretically proved, in which the decoupled Stokes solver needs to be analyzed in details. Optimal-order convergence of $\mathcal{O} (\tau^2+h^{r+1})$ in the discrete $L^\infty(0,T;L^2)$ norm is proved for the proposed decoupled projection finite element scheme, where $\tau$ and $h$ are the time stepsize and spatial mesh size, respectively, and $r$ is the degree of the finite elements. Existing error estimates of second-order projection methods of the Van Kan type \cite{vankan1986} were only established in the discrete $L^2(0,T;L^2)$ norm for the Navier--Stokes equations. Numerical examples are provided to illustrate the theoretical results.

Inverse problems are more challenging when only partial data are available in general. In this paper, we propose a two-step approach combining the extended sampling method and the ensemble Kalman filter to reconstruct an elastic rigid obstacle using partial data. In the first step, the approximate location of the unknown obstacle is obtained by the extended sampling method. In the second step, the ensemble Kalman filter is employed to reconstruct the shape. The location obtained in the first step guides the construction of the initial particles of the ensemble Kalman filter, which is critical to the performance of the second step. Both steps are based on the same physical model and use the same scattering data. Numerical examples are shown to illustrate the effectiveness of the proposed method.

This paper is concerned with the boundary integral equation method for solving the exterior Neumann boundary value problem of dynamic poroelasticity in two dimensions. The main contribution of this work consists of two aspescts: the proposal of a novel regularized boundary integral equation, and the presentation of new regularized formulations of the strongly-singular and hyper-singular boundary integral operators. Firstly, turning to the spectral properties of the double-layer operator and the corresponding Calder\'{o}n relation of the poroelasticity, we propose the novel low-GMRES-iteration integral equation whose eigenvalues are bounded away from zero and infinity. Secondly, with the help of the G\"{u}nter derivatives, we reformulate the strongly-singular and hyper-singular integral operators into combinations of the weakly-singular operators and the tangential derivatives. The accuracy and efficiency of the proposed methodology are demonstrated through several numerical examples., Comment: 22 pages, 6 figures, 4 tables

A quality-Bayesian approach, combining the direct sampling method and the Bayesian inversion, is proposed to reconstruct the locations and intensities of the unknown acoustic sources using partial data. First, we extend the direct sampling method by constructing a new indicator function to obtain the approximate locations of the sources. The behavior of the indicator is analyzed. Second, the inverse problem is formulated as a statistical inference problem using the Bayes' formula. The well-posedness of the posterior distribution is proved. The source locations obtained in the first step are coded in the priors. Then an Metropolis-Hastings MCMC algorithm is used to explore the posterior density. Both steps use the same physical model and measured data. Numerical experiments show that the proposed method is effective even with partial data.

The K-means algorithm is arguably the most popular data clustering method, commonly applied to processed datasets in some "feature spaces", as is in spectral clustering. Highly sensitive to initializations, however, K-means encounters a scalability bottleneck with respect to the number of clusters K as this number grows in big data applications. In this work, we promote a closely related model called K-indicators model and construct an efficient, semi-convex-relaxation algorithm that requires no randomized initializations. We present extensive empirical results to show advantages of the new algorithm when K is large. In particular, using the new algorithm to start the K-means algorithm, without any replication, can significantly outperform the standard K-means with a large number of currently state-of-the-art random replications.

In this paper, we aim to develop a hybridizable discontinuous Galerkin (HDG) method for the indefinite time-harmonic Maxwell equations with the perfectly conducting boundary in the three-dimensional space. First, we derive the wavenumber explicit regularity result, which plays an important role in the error analysis for the HDG method. Second, we prove a discrete inf-sup condition which holds for all positive mesh size $h$, for all wavenumber $k$, and for general domain $\Omega$. Then, we establish the optimal order error estimates of the underlying HDG method with constant independent of the wavenumber. The theoretical results are confirmed by numerical experiments.

In this paper, we first devise an ensemble hybridizable discontinuous Galerkin (HDG) method to efficiently simulate a group of parameterized convection diffusion PDEs. These PDEs have different coefficients, initial conditions, source terms and boundary conditions. The ensemble HDG discrete system shares a common coefficient matrix with multiple right hand side (RHS) vectors; it reduces both computational cost and storage. We have two contributions in this paper. First, we derive an optimal $L^2$ convergence rate for the ensemble solutions on a general polygonal domain, which is the first such result in the literature. Second, we obtain a superconvergent rate for the ensemble solutions after an element-by-element postprocessing under some assumptions on the domain and the coefficients of the PDEs. We present numerical experiments to confirm our theoretical results.

In this paper, we consider numerical solutions of a time domain acoustic-elastic wave interaction problem which occurs between a bounded penetrable elastic body and a compressible inviscid fluid. It is also called the fluid-solid interaction problem. Firstly, an artificial boundary is introduced to transform the original transmission problem into a problem in a bounded region, and then its well-posed results are presented. We then employ a symmetric interior penalty discontinuous Galerkin method for the solution of the reduced interaction problem consisting of second-order wave equations. A priori error estimate in the energy norm is presented, and numerical results confirm the accuracy and validity of the proposed method., Comment: Submitted to ESAIM M2AN

It is known that both linear and nonlinear optical phenomena can be produced when the plasmon in metallic nanostructures are excited by the external electromagnetic waves. In this work, a coupled system of Maxwell equations and a gas dynamic model including a quantum pressure term is employed to simulate the plasmon dynamics of free electron fluid in different metallic nanostructures using a discontinuous Galerkin method in two dimensions. Numerical benchmarks demonstrate that the proposed numerical method can simulate both the high order harmonic generation and the nonlocal effect from metallic nanostructures. Based on the switch-on-and-off investigation, we can conclude that the quantum pressure term in gas dynamics is responsible for the bulk plasmon resonance. In addition, for the dielectric-filled nano-cavity, a coupled effective polarization model is further adopted to investigate the optical behavior of bound electrons. Concerning the numerical setting in this work, a strengthened influence of bound electrons on the generation of high order harmonic waves has been observed., Comment: 17 pages, 11 figures

The quad-curl problem arises in magnetohydrodynamics, inverse electromagnetic scattering and transform eigenvalue problems. In this paper we investigate a hybridizable discontinuous Galerkin method to solve the quad-curl problem based on a mixed formulation. The divergence-free condition is enforced by introducing a Lagrange multiplier into the system. The analysis is performed for the model problem with low regularity, which is posed on a Lipschitz polyhedron domain., Comment: arXiv admin note: text overlap with arXiv:1805.09291

We present a novel approach for the numerical solution of problems of elastic scattering by open arcs in two dimensions. Our methodology relies on the composition of weighted versions of the classical operators associated with Dirichlet and Neumann boundary conditions in conjunction with a certain "open-arc elastic Calder\'on relation" whose validity is demonstrated in this paper on the basis of numerical experiments, but whose rigorous mathematical proof is left for future work. Using this Calder\'on relation in conjunction with spectrally accurate quadrature rules and the Krylov-subspace linear algebra solver GMRES, the proposed overall open-arc elastic solver produces results of high accuracy in small number of iterations---for low and high frequencies alike. A variety of numerical examples in this paper demonstrate the accuracy and efficiency of the proposed methodology., Comment: 19 pages, 6 figures, 6 tables

In this work, we investigate numerical solutions of the two-dimensional shallow water wave using a fully nonlinear Green-Naghdi model with an improved dispersive effect. For the purpose of numerics, the Green-Naghdi model is rewritten into a formulation coupling a pseudo-conservative system and a set of pseudo-elliptic equations. Since the pseudo-conservative system is no longer hyperbolic and its Riemann problem can only be approximately solved, we consider the utilization of the central discontinuous Galerkin method which possesses an important feature of needlessness of Riemann solvers. Meanwhile, the stationary elliptic part will be solved using the finite element method. Both the well-balanced and the positivity-preserving features which are highly desirable in the simulation of the shallow water wave will be embedded into the proposed numerical scheme. The accuracy and efficiency of the numerical model and method will be illustrated through numerical tests., Comment: 27 pages, 35 figures

A new fully discrete linearized $H^1$-conforming Lagrange finite element method is proposed for solving the two-dimensional magneto-hydrodynamics equations based on a magnetic potential formulation. The proposed method yields numerical solutions that converge in general domains that may be nonconvex, nonsmooth and multi-connected. The convergence of subsequences of the numerical solutions is proved only based on the regularity of the initial conditions and source terms, without extra assumptions on the regularity of the solution. Strong convergence in $L^2(0,T;{\bf L}^2(\Omega))$ was proved for the numerical solutions of both ${\bm u}$ and ${\bm H}$ without any mesh restriction.

In this paper, we consider the boundary integral equation (BIE) method for solving the exterior Neumann boundary value problems of elastic and thermoelastic waves in three dimensions based on the Fredholm integral equations of the first kind. The innovative contribution of this work lies in the proposal of the new regularized formulations for the hyper-singular boundary integral operators (BIO) associated with the time-harmonic elastic and thermoelastic wave equations. With the help of the new regularized formulations, we only need to compute the integrals with weak singularities at most in the corresponding variational forms of the boundary integral equations. The accuracy of the regularized formulations is demonstrated through numerical examples using the Galerkin boundary element method (BEM)., Comment: 24 pages, 6 figures

In this paper, we investigate wave propagation in orthotropic poroelastic media by studying the time-domain poroelastic equations. Both the low frequency Biot's (LF-Biot) equations and the Biot-Johnson-Koplik-Dashen (Biot-JKD) models are considered. In LF-Biot equations, the dissipation terms are proportional to the relative velocity between the fluid and the solid by a constant. Contrast to this, the dissipation terms in the Biot-JKD model are in the form of time convolution (memory) as a result of the frequency-dependence of fluid-solid interaction at the underlying microscopic scale in the frequency domain. The dynamic tortuosity and permeability described by Darcy's law are two crucial factors in this problem, and highly linked to the viscous force. In the Biot model, the key difficulty is to handle the viscous term when the pore fluid is viscous flow. In the Biot-JKD dynamic permeability model, the convolution operator involves order $1/2$ shifted fractional derivatives in the time domain, which is challenging to discretize. In this work, we utilize the multipoint Pad$\acute{e}$ (or Rational) approximation for Stieltjes function to approximate the dynamic tortuosity and then obtain an augmented system of equations which avoids storing the solutions of the past time. The Runge-Kutta discontinuous Galerkin (RKDG) method is used to compute the numerical solution, and numerical examples are presented to demonstrate the high order accuracy and stability of the method.

The quad-curl term is an essential part of the resistive magnetohydrodynamic (MHD) equation and the fourth order inverse electromagnetic scattering problem, which are both of great significance in science and engineering. It is desirable to develop efficient and practical numerical methods for the quad-curl problem. In this paper, we first present some new regularity results for the quad-curl problem on Lipschitz polyhedron domains and then propose a mixed finite element method for solving the quad-curl problem. With a {\em novel} discrete Sobolev imbedding inequality for the piecewise polynomials, we obtain stability results and derive error estimates based on a relatively low regularity assumption of the exact solution.

In this paper, we study a hybridizable discontinuous Galerkin (HDG) method for the Maxwell operator. The only global unknowns are defined on the inter-element boundaries, and the numerical solutions are obtained by using discontinuous polynomial approximations. The error analysis is based on a mixed curl-curl formulation for the Maxwell equations. Theoretical results are obtained under a more general regularity requirement. In particular for the low regularity case, special treatment is applied to approximate data on the boundary. The HDG method is shown to be stable and convergence in an optimal order for both high and low regularity cases. Numerical experiments with both smooth and singular analytical solutions are performed to verify the theoretical results.