Search

The main goal of this work is to provide a description of transitions from uniform to non-uniform snychronization in diffusions based on large deviation estimates for finite time Lyapunov exponents. These can be characterized in terms of moment Lyapunov exponents which are principal eigenvalues of the generator of the tilted (Feynman-Kac) semigroup. Using a computer assisted proof, we demonstrate how to determine these eigenvalues and investigate the rate function which is the Legendre-Fenichel transform of the moment Lyapunov function. We apply our results to two case studies: the pitchfork bifurcation and a two-dimensional toy model, also considering the transition to a positive asymptotic Lyapunov exponent.

For overparameterized optimization tasks, such as the ones found in modern machine learning, global minima are generally not unique. In order to understand generalization in these settings, it is vital to study to which minimum an optimization algorithm converges. The possibility of having minima that are unstable under the dynamics imposed by the optimization algorithm limits the potential minima that the algorithm can find. In this paper, we characterize the global minima that are dynamically stable/unstable for both deterministic and stochastic gradient descent (SGD). In particular, we introduce a characteristic Lyapunov exponent which depends on the local dynamics around a global minimum and rigorously prove that the sign of this Lyapunov exponent determines whether SGD can accumulate at the respective global minimum.

We study the synchronization behavior of discrete-time Markov chains on countable state spaces. Representing a Markov chain in terms of a random dynamical system, which describes the collective dynamics of trajectories driven by the same noise, allows for the characterization of synchronization via random attractors. We establish the existence and uniqueness of a random attractor under mild conditions and show that forward and pullback attraction are equivalent in our setting. Additionally, we provide necessary and sufficient conditions for reaching the random attractor, or synchronization respectively, in a time of finite mean. By introducing insulated and synchronizing sets, we structure the state space with respect to the synchronization behavior and characterize the shape of the random attractor.

We study a prototypical non-polynomial decision-making model for which agents in a population potentially alternate between two consumption strategies, one related to the exploitation of an unlimited but considerably expensive resource and the other a comparably cheaper but restricted and slowly renewable source. In particular, we study a model following a Boltzmann-like exploration policy, enhancing the accuracy at which the exchange rates are captured with respect to classical polynomial approaches by considering sigmoidal functions to represent the cost-profit relation in both exploit strategies. Additionally, given the intrinsic timescale separation between the decision-making process and recovery rates of the renewable resource, we use geometric singular perturbation theory to analyze the model. We further use numerical analysis to determine parameter ranges for which the model undergoes bifurcations. These bifurcations, being related to critical states of the system, are relevant to the fast transitions between strategies. Hence, we design controllers to regulate such rapid transitions by taking advantage of the system's criticality., Comment: 40 pages, 20 figures

Coherent sets are time-dependent regions in the physical space of nonautonomous flows that exhibit little mixing with their neighborhoods, robustly under small random perturbations of the flow. They thus characterize the global long-term transport behavior of the system. We propose a framework to extract such time-dependent families of coherent sets for nonautonomous systems with an ergodic driving dynamics and (small) Brownian noise in physical space. Our construction involves the assembly and analysis of an operator on functions over the augmented space of the associated skew product that, for each fixed state of the driving, propagates distributions on the corresponding physical-space fibre according to the dynamics. This time-dependent operator has the structure of a semigroup (it is called the Mather semigroup), and we show that a spectral analysis of its generator allows for a trajectory-free computation of coherent families, simultaneously for all states of the driving. Additionally, for quasi-periodically driven torus flows, we propose a tailored Fourier discretization scheme for this generator and demonstrate our method by means of three examples of two-dimensional flows.

The combination of functional limit theorems with the pathwise analysis of deterministic and stochastic differential equations has proven to be a powerful approach to the analysis of fast-slow systems. In a multivariate setting, this requires rough path ideas, as already suggested in the seminal work [Melbourne-Stuart, Nonlinearity, 24, 2011]. This initiated a program pursued by numerous authors and which has required substantial results on invariance principles (also known as functional central limit theorems) in rough path topologies. We take a unified point of view and provide simple and exact formulas, of the Green-Kubo type, that characterize the relevant Brownian rough path limits and discuss how they naturally apply in different settings., Comment: 23 pages

In this work we study the Brusselator - a prototypical model for chemical oscillations - under the assumption that the bifurcation parameter is of order $O(1/\epsilon)$ for positive $\epsilon\ll 1$. The dynamics of this mathematical model exhibits a time scale separation visible via fast and slow regimes along its unique attracting limit cycle. Noticeably this limit cycle accumulates at infinity as $\epsilon\rightarrow 0$, so that in polar coordinates $(\theta,r)$, and by doing a further change of variable $r\mapsto r^{-1}$, we analyse the dynamics near the line at infinity, corresponding to the set $\{r=0\}$. This object becomes a nonhyperbolic invariant manifold for which we use a desingularising rescaling, in order to study the closeby dynamics. Further use of geometric singular perturbation techniques allows us to give a decomposition of the Brusselator limit cycle in terms of four different fully quantified time scales.

We consider a stochastic version of the so-called Brusselator - a mathematical model for a two-dimensional chemical reaction network - in which one of its parameters is assumed to vary randomly. It has been suggested via numerical explorations that the system exhibits noise-induced synchronization when time goes to infinity. Complementing this perspective, in this work we explore some of its finite-time features from a random dynamical systems perspective. In particular, we focus on the deviations that orbits of neighboring initial conditions exhibit under the influence of the same noise realization. For this, we explore its local instabilities via finite-time Lyapunov exponents. Furthermore, we present the stochastic Brusselator as a fast-slow system in the case that one of the parameters is much larger than the other one. In this framework, an apparent mechanism for generating the stochastic instabilities is revealed, being associated to the transition between the slow and fast regimes.

We consider linear cocycles taking values in $\textup{SL}_d(\mathbb{R})$ driven by homeomorphic transformations of a smooth manifold, in discrete and continuous time. We show that any discrete-time cocycle can be extended to a continuous-time cocycle, while preserving its characteristic properties. We provide a necessary and sufficient condition under which this extension is natural in the sense that the base is extended to an associated suspension flow and that the dimension of the cocycle does not change. Further, we refine our general result for the case of (quasi-)periodic driving. As an example, we present a discrete-time cocycle due to Michael Herman. The Furstenberg--Kesten limits of this cocycle do not exist everywhere and its Oseledets splitting is discontinuous. Our results on the continuous-time extension of discrete-time cocycles allow us to construct a continuous-time cocycle with analogous properties.

Canards are a well-studied phenomenon in fast-slow ordinary differential equations implying the delayed loss of stability after the slow passage through a singularity. Recent studies have shown that the corresponding maps stemming from explicit Runge-Kutta discretizations, in particular the forward Euler scheme, exhibit significant distinctions to the continuous-time behavior: for folds, the delay in loss of stability is typically shortened whereas, for transcritical singularities, it is arbitrarily prolonged. We employ the method of modified equations, which correspond with the fixed discretization schemes up to higher order, to understand and quantify these effects directly from a fast-slow ODE, yielding consistent results with the discrete-time behavior and opening a new perspective on the wide range of (de-)stabilization phenomena along canards.

We study the behavior of a stochastic variant of replicator dynamics in two-agent zero-sum games. We characterize the statistics of such systems by their invariant measures which can be shown to be entirely supported on the boundary of the space of mixed strategies. Depending on the noise strength we can furthermore characterize these invariant measures by finding accumulation of mass at specific parts of the boundary. In particular, regardless of the magnitude of noise, we show that any invariant probability measure is a convex combination of Dirac measures on pure strategy profiles, which correspond to vertices/corners of the agents' simplices. Thus, in the presence of stochastic perturbations, even in the most classic zero-sum settings, such as Matching Pennies, we observe a stark disagreement between the axiomatic prediction of Nash equilibrium and the evolutionary emergent behavior derived by an assumption of stochastically adaptive, learning agents.

We prove the positivity of Lyapunov exponents for the normal form of a Hopf bifurcation, perturbed by additive white noise, under sufficiently strong shear strength. This completes a series of related results for simplified situations which we can exploit by studying suitable limits of the shear and noise parameters. The crucial technical ingredient for making this approach rigorous is a result on the continuity of Lyapunov exponents via Furstenberg Khasminskii formulas., Comment: 35 pages

We study a singularly perturbed fast-slow system of two partial differential equations (PDEs) of reaction-diffusion type on a bounded domain. We assume that the reaction terms in the fast variable contain a fold singularity, whereas the slow variable assumes the role of a dynamic bifurcation parameter, thus extending the classical analysis of a fast-slow dynamic fold bifurcation to an infinite-dimensional setting. Our approach combines a spectral Galerkin discretisation with techniques from Geometric Singular Perturbation Theory (GSPT) which are applied to the resulting high-dimensional systems of ordinary differential equations (ODEs). In particular, we show the existence of invariant manifolds away from the fold singularity, while the dynamics in a neighbourhood of the singularity is described by geometric desingularisation, via the blow-up technique. Finally, we relate the Galerkin manifolds that are obtained after the discretisation to the invariant manifolds which exist in the phase space of the original system of PDEs., Comment: 41 pages with 9 figures. Corresponding author: Thomas Zacharis

This work explores a synchronization-like phenomenon induced by common noise for continuous-time Markov jump processes given by chemical reaction networks. A corresponding random dynamical system is formulated in a two-step procedure, at first for the states of the embedded discrete-time Markov chain and then for the augmented Markov chain including also random jump times. We uncover a time-shifted synchronization in the sense that -- after some initial waiting time -- one trajectory exactly replicates another one with a certain time delay. Whether or not such a synchronization behaviour occurs depends on the combination of the initial states. We prove this partial time-shifted synchronization for the special setting of a birth-death process by analyzing the corresponding two-point motion of the embedded Markov chain and determine the structure of the associated random attractor. In this context, we also provide general results on existence and form of random attractors for discrete-time, discrete-space random dynamical systems.

We establish the existence of a full spectrum of Lyapunov exponents for memoryless random dynamical systems with absorption. To this end, we crucially embed the process conditioned to never being absorbed, the Q-process, into the framework of random dynamical systems, allowing us to study multiplicative ergodic properties. We show that the finite-time Lyapunov exponents converge in conditioned probability and apply our results to iterated function systems and stochastic differential equations., Comment: 36 pages, 0 figures

We study in detail the role of covariant Lyapunov vectors and their respective angles for detecting transitions between metastable states in dynamical systems, as recently discussed in several atmospheric science applications. The underlying models are built from data by the dynamical clustering method, called FEM-BV-VAR, and the Lyapunov vectors are approximated based on these models. We test this data-based numerical approach at the hand of three well-understood example systems with increasing dynamical complexity, identifying crucial properties that allow for a successful application of the method: in particular, it turns out that the method requires a clear multiple time scale structure with fast transitions between slow subsystems which can be dynamically characterized by invariant neutral directions of the linear approximation model.

We investigate pitchfork bifurcations for a stochastic reaction diffusion equation perturbed by an infinite-dimensional Wiener process. It is well-known that the random attractor is a singleton, independently of the value of the bifurcation parameter; this phenomenon is often referred to as the "destruction" of the bifurcation by the noise. Analogous to the results of [Callaway et al., AIHP Probab. Stat., 53:1548-1574, 2017] for a 1D stochastic ODE, we show that some remnant of the bifurcation persists for this SPDE model in the form of a positive finite-time Lyapunov exponent. Additionally, we prove finite-time expansion of volume with increasing dimension as the bifurcation parameter crosses further eigenvalues of the Laplacian.

Using various techniques from dynamical systems theory, we rigorously study an experimentally validated model by [Barkley et al., Nature, 526:550-553, 2015], which describes the rise of turbulent pipe flow via a PDE system of reduced complexity. The fast evolution of turbulence is governed by reaction-diffusion dynamics coupled to the centerline velocity, which evolves with advection of Burgers' type and a slow relaminarization term. Applying to this model a spatial dynamics ansatz and geometric singular perturbation theory, we prove the existence of a heteroclinic loop between a turbulent and a laminar steady state and establish a cascade of bifurcations of various traveling waves mediating the transition to turbulence. The most complicated behaviour can be found in an intermediate Reynolds number regime, where the traveling waves exhibit arbitrarily long periodic-like dynamics indicating the onset of chaos. Our analysis provides a systematic mathematical approach to identifying the transition to spatio-temporal turbulent structures that may also be applicable to other models arising in fluid dynamics.

In this paper, we review several results from singularly perturbed differential equations with multiple small parameters. In addition, we develop a general conceptual framework to compare and contrast the different results by proposing a three-step process. First, one specifies the setting and restrictions of the differential equation problem to be studied and identifies the relevant small parameters. Second, one defines a notion of equivalence via a property/observable for partitioning the parameter space into suitable regions near the singular limit. Third, one studies the possible asymptotic singular limit problems as well as perturbation results to complete the diagrammatic subdivision process. We illustrate this approach for two simple problems from algebra and analysis. Then we proceed to the review of several modern double-limit problems including multiple time scales, stochastic dynamics, spatial patterns, and network coupling. For each example, we illustrate the previously mentioned three-step process and show that already double-limit parametric diagrams provide an excellent unifying theme. After this review, we compare and contrast the common features among the different examples. We conclude with a brief outlook, how our methodology can help to systematize the field better, and how it can be transferred to a wide variety of other classes of differential equations.

In this paper, we study slow manifolds for infinite-dimensional evolution equations. We compare two approaches: an abstract evolution equation framework and a finite-dimensional spectral Galerkin approximation. We prove that the slow manifolds constructed within each approach are asymptotically close under suitable conditions. The proof is based upon Lyapunov-Perron methods and a comparison of the local graphs for the slow manifolds in scales of Banach spaces. In summary, our main result allows us to change between different characterizations of slow invariant manifolds, depending upon the technical challenges posed by particular fast-slow systems., Comment: 15 pages

We confirm a long-standing conjecture concerning shear-induced chaos in stochastically perturbed systems exhibiting a Hopf bifurcation. The method of showing the main chaotic property, a positive Lyapunov exponent, is a computer-assisted proof. Using the recently developed theory of conditioned Lyapunov exponents on bounded domains and the modified Furstenberg-Khasminskii formula, the problem boils down to the rigorous computation of eigenfunctions of the Kolmogorov operators describing distributions of the underlying stochastic process.

We consider a fast-slow partial differential equation (PDE) with reaction-diffusion dynamics in the fast variable and the slow variable driven by a differential operator on a bounded domain. Assuming a transcritical normal form for the reaction term and viewing the slow variable as a dynamic bifurcation parameter, we analyze the passage through the fast subsystem bifurcation point for the spectral Galerkin approximation of the PDE. We characterize the invariant manifolds for the finite-dimensional Galerkin ODEs using geometric desingularization via a blow-up analysis. In addition to the crucial approximation procedure, we also make the domain dynamic during the blow-up analysis. Finally, we elaborate in which sense our results approximate the infinite-dimensional problem. Within our analysis, we find that the PDEs appearing in entry and exit blow-up charts are quasi-linear free boundary value problems, while in the central/scaling chart we obtain a PDE, which is often encountered in classical reaction-diffusion problems exhibiting solutions with finite-time singularities.

In this paper we study coupled fast-slow ordinary differential equations (ODEs) with small time scale separation parameter $\epsilon$ such that, for every fixed value of the slow variable, the fast dynamics are sufficiently chaotic with ergodic invariant measure. Convergence of the slow process to the solution of a homogenized stochastic differential equation (SDE) in the limit $\epsilon$ to zero, with explicit formulas for drift and diffusion coefficients, has so far only been obtained for the case that the fast dynamics evolve independently. In this paper we give sufficient conditions for the convergence of the first moments of the slow variable in the coupled case. Our proof is based upon a new method of stochastic regularization and functional-analytical techniques combined via a double limit procedure involving a zero-noise limit as well as considering $\epsilon$ to zero. We also give exact formulas for the drift and diffusion coefficients for the limiting SDE. As a main application of our theory, we study \emph{weakly-coupled} systems, where the coupling only occurs in lower time scales and our conditions are more easily verifiable requiring only mild, namely summable, decay of correlations., Comment: 32 pages, 3 figures

We study fast-slow maps obtained by discretization of planar fast-slow systems in continuous time. We focus on describing the so-called delayed loss of stability induced by the slow passage through a singularity in fast-slow systems. This delayed loss of stability can be related to the presence of canard solutions. Here we consider three types of singularities: transcritical, pitchfork, and fold. First, we show that under an explicit Runge-Kutta discretization the delay in loss of stability, due to slow passage through a transcritical or a pitchfork singularity, can be arbitrarily long. In contrast, we prove that under a Kahan-Hirota-Kimura discretization scheme, the delayed loss of stability related to all three singularities is completely symmetric in the linearized approximation, in perfect accordance with the continuous-time setting., Comment: Several improvements

For an attracting periodic orbit (limit cycle) of a deterministic dynamical system, one defines the isochron for each point of the orbit as the cross-section with fixed return time under the flow. Equivalently, isochrons can be characterized as stable manifolds foliating neighborhoods of the limit cycle or as level sets of an isochron map. In recent years, there has been a lively discussion in the mathematical physics community on how to define isochrons for stochastic oscillations, i.e. limit cycles or heteroclinic cycles exposed to stochastic noise. The main discussion has concerned an approach finding stochastic isochrons as sections of equal expected return times versus the idea of considering eigenfunctions of the backward Kolmogorov operator. We discuss the problem in the framework of random dynamical systems and introduce a new rigorous definition of stochastic isochrons as random stable manifolds for random periodic solutions with noise-dependent period. This allows us to establish a random version of isochron maps whose level sets coincide with the random stable manifolds. Finally, we discuss links between the random dynamical systems interpretation and the equal expected return time approach via averaged quantities.

We study the problem of preservation of maximal canards for time discretized fast-slow systems with canard fold points. In order to ensure such preservation, certain favorable structure preserving properties of the discretization scheme are required. Conventional schemes do not possess such properties. We perform a detailed analysis for an unconventional discretization scheme due to Kahan. The analysis uses the blow-up method to deal with the loss of normal hyperbolicity at the canard point. We show that the structure preserving properties of the Kahan discretization for quadratic vector fields imply a similar result as in continuous time, guaranteeing the occurrence of maximal canards between attracting and repelling slow manifolds upon variation of a bifurcation parameter. The proof is based on a Melnikov computation along an invariant separating curve, which organizes the dynamics of the map similarly to the ODE problem.

Motivated by the normal form of a fast-slow ordinary differential equation exhibiting a pitchfork singularity we consider the discrete-time dynamical system that is obtained by an application of the explicit Euler method. Tracking trajectories in the vicinity of the singularity we show, how the slow manifold extends beyond the singular point and give an estimate on the contraction rate of a transition mapping. The proof relies on the blow-up method suitably adapted to the discrete setting where a key technical contribution are precise estimates for a cubic map in the central rescaling chart., Comment: 29 pages, 7 figures

We translate a coagulation-framentation model, describing the dynamics of animal group size distributions, into a model for the population distribution and associate the \blue{nonlinear} evolution equation with a Markov jump process of a type introduced in classic work of H.~McKean. In particular this formalizes a model suggested by H.-S. Niwa [J.~Theo.~Biol.~224 (2003)] with simple coagulation and fragmentation rates. Based on the jump process, we develop a numerical scheme that allows us to approximate the equilibrium for the Niwa model, validated by comparison to analytical results by Degond et al. [J.~Nonlinear Sci.~27 (2017)], and study the population and size distributions for more complicated rates. Furthermore, the simulations are used to describe statistical properties of the underlying jump process. We additionally discuss the relation of the jump process to models expressed in stochastic differential equations and demonstrate that such a connection is justified in the case of nearest-neighbour interactions, as opposed to global interactions as in the Niwa model.

We extend slow manifolds near a transcritical singularity in a fast-slow system given by the explicit Euler discretization of the corresponding continuous-time normal form. The analysis uses the blow-up method and direct trajectory-based estimates. We prove that the qualitative behaviour is preserved by a time-discretization with sufficiently small step size. This step size is fully quantified relative to the time scale separation. Our proof also yields the continuous-time results as a special case and provides more detailed calculations in the classical (or scaling) chart.

We introduce the notion of Lyapunov exponents for random dynamical systems, conditioned to trajectories that stay within a bounded domain for asymptotically long times. This is motivated by the desire to characterize local dynamical properties in the presence of unbounded noise (when almost all trajectories are unbounded). We illustrate its use in the analysis of local bifurcations in this context. The theory of conditioned Lyapunov exponents of stochastic differential equations builds on the stochastic analysis of quasi-stationary distributions for killed processes and associated quasi-ergodic distributions. We show that conditioned Lyapunov exponents describe the local stability behaviour of trajectories that remain within a bounded domain and - in particular - that negative conditioned Lyapunov exponents imply local synchronisation. Furthermore, a conditioned dichotomy spectrum is introduced and its main characteristics are established.

We consider the dynamics of a two-dimensional ordinary differential equation exhibiting a Hopf bifurcation subject to additive white noise and identify three dynamical phases: (I) a random attractor with uniform synchronisation of trajectories, (II) a random attractor with non-uniform synchronisation of trajectories and (III) a random attractor without synchronisation of trajectories. The random attractors in phases (I) and (II) are random equilibrium points with negative Lyapunov exponents while in phase (III) there is a so-called random strange attractor with positive Lyapunov exponent. We analyse the occurrence of the different dynamical phases as a function of the linear stability of the origin (deterministic Hopf bifurcation parameter) and shear (ampitude-phase coupling parameter). We show that small shear implies synchronisation and obtain that synchronisation cannot be uniform in the absence of linear stability at the origin or in the presence of sufficiently strong shear. We provide numerical results in support of a conjecture that irrespective of the linear stability of the origin, there is a critical strength of the shear at which the system dynamics loses synchronisation and enters phase (III).

We establish the existence of a bifurcation from an attractive random equilibrium to shear-induced chaos for a stochastically driven limit cycle, indicated by a change of sign of the first Lyapunov exponent. This addresses an open problem posed by Kevin Lin and Lai-Sang Young, extending results by Qiudong Wang and Lai-Sang Young on periodically kicked limit cycles to the stochastic context.

We study numerically a coagulation-fragmentation model derived by Niwa and further elaborated by Degond et al., where a unique equilibrium distribution of group sizes is shown to exist in both cases of continuous and discrete group size distributions. We provide a numerical investigation of these equilibria using three different methods to approximate the equilibrium: a recursive algorithm based on the work of Ma et. al., a Newton method and the resolution of the time-dependent problem. All three schemes are validated by showing that they approximate the predicted small and large size asymptotic behaviour of the equilibrium accurately. The recursive algorithm is used to investigate the transition from discrete to continuous size distributions and the time evolution scheme is exploited to show uniform convergence to equilibrium in time and to determine convergence rates.