Search

Solutions exhibiting weak initial singularities arise in various equations, including diffusion and subdiffusion equations. When employing the well-known L1 scheme to solve subdiffusion equations with weak singularities, numerical simulations reveal that this scheme exhibits varying convergence rates for different choices of model parameters (i.e., domain size, final time $T$, and reaction coefficient $\kappa$). This elusive phenomenon is not unique to the L1 scheme but is also observed in other numerical methods for reaction-diffusion equations such as the backward Euler (IE) scheme, Crank-Nicolson (C-N) scheme, and two-step backward differentiation formula (BDF2) scheme. The existing literature lacks an explanation for the existence of two different convergence regimes, which has puzzled us for a long while and motivated us to study this inconsistency between the standard convergence theory and numerical experiences. In this paper, we provide a general methodology to systematically obtain error estimates that incorporate the exponential decaying feature of the solution. We term this novel error estimate the `decay-preserving error estimate' and apply it to the aforementioned IE, C-N, and BDF2 schemes. Our decay-preserving error estimate consists of a low-order term with an exponential coefficient and a high-order term with an algebraic coefficient, both of which depend on the model parameters. Our estimates reveal that the varying convergence rates are caused by a trade-off between these two components in different model parameter regimes. By considering the model parameters, we capture different states of the convergence rate that traditional error estimates fail to explain. This approach retains more properties of the continuous solution. We validate our analysis with numerical results., Comment: 25 pages, 4 figures

Numerous error estimates have been carried out on various numerical schemes for subdiffusion equations. Unfortunately most error bounds suffer from a factor $1/(1-\alpha)$ or $\Gamma(1-\alpha)$, which blows up as the fractional order $\alpha\to 1^-$, a phenomenon not consistent with regularity of the continuous problem and numerical simulations in practice. Although efforts have been made to avoid the factor blow-up phenomenon, a robust analysis of error estimates still remains incomplete for numerical schemes with general nonuniform time steps. In this paper, we will consider the $\alpha$-robust error analysis of convolution-type schemes for subdiffusion equations with general nonuniform time-steps, and provide explicit factors in error bounds with dependence information on $\alpha$ and temporal mesh sizes. As illustration, we apply our abstract framework to two widely used schemes, i.e., the L1 scheme and Alikhanov's scheme. Our rigorous proofs reveal that the stability and convergence of a class of convolution-type schemes is $\alpha$-robust, i.e., the factor will not blowup while $\alpha\to 1^-$ with general nonuniform time steps even when rather general initial regularity condition is considered., Comment: 21 pages

An adaptive implicit-explicit (IMEX) BDF2 scheme is investigated on generalized SAV approach for the Cahn-Hilliard equation by combining with Fourier spectral method in space. It is proved that the modified energy dissipation law is unconditionally preserved at discrete levels. Under a mild ratio restriction, i.e., \Ass{1}: $0

The recently developed technique of DOC kernels has been a great success in the stability and convergence analysis for BDF2 scheme with variable time steps. However, such an analysis technique seems not directly applicable to problems with initial singularity. In the numerical simulations of solutions with initial singularity, variable time-steps schemes like the graded mesh are always adopted to achieve the optimal convergence, whose first adjacent time-step ratio may become pretty large so that the acquired restriction is not satisfied. In this paper, we revisit the variable time-step implicit-explicit two-step backward differentiation formula (IMEX BDF2) scheme presented in [W. Wang, Y. Chen and H. Fang, \emph{SIAM J. Numer. Anal.}, 57 (2019), pp. 1289-1317] to compute the partial integro-differential equations (PIDEs) with initial singularity. We obtain the sharp error estimate under a mild restriction condition of adjacent time-step ratios $r_{k}: =\tau_{k}/\tau_{k-1} \; (k\geq 3) < r_{\max} = 4.8645 $ and a much mild requirement on the first ratio, i.e., $r_2>0$. This leads to the validation of our analysis of the variable time-step IMEX BDF2 scheme when the initial singularity is dealt by a simple strategy, i.e., the graded mesh $t_k=T(k/N)^{\gamma}$. In this situation, the convergence of order $\mathcal{O}(N^{-\min\{2,\gamma \alpha\}})$ is achieved with $N$ and $\alpha$ respectively representing the total mesh points and indicating the regularity of the exact solution. This is, the optical convergence will be achieved by taking $\gamma_{\text{opt}}=2/\alpha$. Numerical examples are provided to demonstrate our theoretical analysis.

In this paper we consider a linearized variable-time-step two-step backward differentiation formula (BDF2) scheme for solving nonlinear parabolic equations. The scheme is constructed by using the variable time-step BDF2 for the linear term and a Newton linearized method for the nonlinear term in time combining with a Galerkin finite element method (FEM) in space. We prove the unconditionally optimal error estimate of the proposed scheme under mild restrictions on the ratio of adjacent time-steps, i.e. $0

We focus on estimating \emph{a priori} generalization error of two-layer ReLU neural networks (NNs) trained by mean squared error, which only depends on initial parameters and the target function, through the following research line. We first estimate \emph{a priori} generalization error of finite-width two-layer ReLU NN with constraint of minimal norm solution, which is proved by \cite{zhang2019type} to be an equivalent solution of a linearized (w.r.t. parameter) finite-width two-layer NN. As the width goes to infinity, the linearized NN converges to the NN in Neural Tangent Kernel (NTK) regime \citep{jacot2018neural}. Thus, we can derive the \emph{a priori} generalization error of two-layer ReLU NN in NTK regime. The distance between NN in a NTK regime and a finite-width NN with gradient training is estimated by \cite{arora2019exact}. Based on the results in \cite{arora2019exact}, our work proves an \emph{a priori} generalization error bound of two-layer ReLU NNs. This estimate uses the intrinsic implicit bias of the minimum norm solution without requiring extra regularity in the loss function. This \emph{a priori} estimate also implies that NN does not suffer from curse of dimensionality, and a small generalization error can be achieved without requiring exponentially large number of neurons. In addition the research line proposed in this paper can also be used to study other properties of the finite-width network, such as the posterior generalization error., Comment: There is a error in this paper that the scale of initialization in this paper is different from the NTK regime. So, the generalization error of the neural network in the NTK regime is baseless