Search

We develop a general approach to Stein's method for approximating a random process in the path space $D([0,T]\to R^d)$ by a real continuous Gaussian process. We then use the approach in the context of processes that have a representation as integrals with respect to anunderlying point process, deriving a general quantitative Gaussian approximation. The error bound is expressed in terms of couplings of the original process to processes generated from the reduced Palm measures associated with the point process. As applications, we study certain $\text{GI}/\text{GI}/\infty$ queues in the "heavy traffic" regime., Comment: 40 pages

Stein's method for Gaussian process approximation can be used to bound the differences between the expectations of smooth functionals $h$ of a c\`adl\`ag random process $X$ of interest and the expectations of the same functionals of a well understood target random process $Z$ with continuous paths. Unfortunately, the class of smooth functionals for which this is easily possible is very restricted. Here, we prove an infinite dimensional Gaussian smoothing inequality, which enables the class of functionals to be greatly expanded -- examples are Lipschitz functionals with respect to the uniform metric, and indicators of arbitrary events -- in exchange for a loss of precision in the bounds. Our inequalities are expressed in terms of the smooth test function bound, an expectation of a functional of $X$ that is closely related to classical tightness criteria, a similar expectation for $Z$, and, for the indicator of a set $K$, the probability $\mathbb{P}(Z \in K^\theta \setminus K^{-\theta})$ that the target process is close to the boundary of $K$., Comment: Ver 4: 33 pages, added Example 1.10, improved some details and discussion, and streamlined some notation; Ver3: 28 pages, corrected a mistake in Lemma 1.10 and added discussion and details, only superficial changes to the main result; Ver2: 21 pages, additional discussion and details; Ver1: 17 pages

We study the degree distribution of a randomly chosen vertex in a duplication--divergence graph, under a variety of different generalizations of the basic model of Bhan, Galas and Dewey (2002) and V\'azquez, Flammini, Maritan and Vespignani (2003). We pay particular attention to what happens when a non-trivial proportion of the vertices have large degrees, establishing a central limit theorem for the logarithm of the degree distribution. Our approach, as in Jordan (2018) and Hermann and Pfaffelhuber (2021), relies heavily on the analysis of related birth--catastrophe processes, and couplings are used to show that a number of different formulations of the process have asymptotically similar expected degree distributions.

The Network Disturbance Model of Doreian (1989) expresses the dependency between observations taken at the vertices of a network by modelling the correlation between neighbouring vertices, using a single correlation parameter $\rho$. It has been observed that estimation of $\rho$ in dense graphs, using the method of Maximum Likelihood, leads to results that can be both biased and very unstable. In this paper, we sketch why this is the case, showing that the variability cannot be avoided, no matter how large the network. We also propose a more intuitive estimator of $\rho$, which shows little bias. The related Network Effects Model is briefly discussed., Comment: 20 pages, 1 Figure; updated version with more details

We present a rather general method for proving local limit theorems, with a good rate of convergence, for sums of dependent random variables. The method is applicable when a Stein coupling can be exhibited. Our approach involves both Stein's method for distributional approximation and Stein's method for concentration. As applications, we prove local central limit theorems with rate of convergence for the number of germs with $d$ neighbours in a germ--grain model, and the number of degree-$d$ vertices in an Erd\H{o}s--R\'enyi random graph. In both cases, the error rate is optimal, up to logarithmic factors., Comment: Ver2: 33 pages, minor revision; Ver 1: 32 pages

We establish two theorems for assessing the accuracy in total variation of multivariate discrete normal approximation to the distribution of an integer valued random vector $W$. The first is for sums of random vectors whose dependence structure is local. The second applies to random vectors~$W$ resulting from integrating the $\mathbb{Z}^d$-valued marks of a marked point process with respect to its ground process. The error bounds are of magnitude comparable to those given in Rinott and Rotar (1996), but now with respect to the stronger total variation distance. Instead of requiring the summands to be bounded, we make third moment assumptions. We demonstrate the use of the theorems in four applications: monochrome edges in vertex coloured graphs, induced triangles and $2$-stars in random geometric graphs, the times spent in different states by an irreducible and aperiodic finite Markov chain, and the maximal points in different regions of a homogeneous Poisson point process., Comment: 39 pages, 4 figures

We derive explicit central moment inequalities for random variables that admit a Stein coupling, such as exchangeable pairs, size--bias couplings or local dependence, among others. The bounds are in terms of moments (not necessarily central) of variables in the Stein coupling, which are typically local in some sense, and therefore easier to bound. In cases where the Stein couplings have the kind of behaviour leading to good normal approximation, the central moments are closely bounded by those of a normal. We show how the bounds can be used to produce concentration inequalities, and compare them to those existing in related settings. Finally, we illustrate the power of the theory by bounding the central moments of sums of neighbourhood statistics in sparse Erd\H{o}s--R\'enyi random graphs., Comment: Ver 3: 25 pages, added a reference and details; Ver 2: 24 pages, additional discussion; Ver1: 21 pages

We consider the approximation of the equilibrium of a metapopulation model, in which a finite number of patches are randomly distributed over a bounded subset $\Omega$ of Euclidean space. The approximation is good when a large number of patches contribute to the colonization pressure on any given unoccupied patch, and when the quality of the patches varies little over the length scale determined by the colonization radius. If this is the case, the equilibrium probability of a patch at $z$ being occupied is shown to be close to $q_1(z)$, the equilibrium occupation probability in Levins's model, at any point $z \in \Omega$ not too close to the boundary, if the local colonization pressure and extinction rates appropriate to $z$ are assumed. The approximation is justified by giving explicit upper and lower bounds for the occupation probabilities, expressed in terms of the model parameters. Since the patches are distributed randomly, the occupation probabilities are also random, and we complement our bounds with explicit bounds on the probability that they are satisfied at all patches simultaneously.

We prove a general normal approximation theorem for local graph statistics in the configuration model, together with an explicit bound on the error in the approximation with respect to the Wasserstein metric. Such statistics take the form $T := \sum_{v \in V} H_v$, where $V$ is the vertex set, and $H_v$ depends on a neighbourhood in the graph around $v$ of size at most $\ell$. The error bound is expressed in terms of $\ell$, $|V|$, an almost sure bound on $H_v$, the maximum vertex degree $d_{\max}$ and the variance of $T$. Under suitable assumptions on the convergence of the empirical degree distributions to a limiting distribution, we deduce that the size of the giant component in the configuration model has asymptotically Gaussian fluctuations., Comment: minor changes

We provide a general result for bounding the difference between point probabilities of integer supported distributions and the translated Poisson distribution, a convenient alternative to the discretized normal. We illustrate our theorem in the context of the Hoeffding combinatorial central limit theorem with integer valued summands, of the number of isolated vertices in an Erd\H{o}s-R\'enyi random graph, and of the Curie-Weiss model of magnetism, where we provide optimal or near optimal rates of convergence in the local limit metric. In the Hoeffding example, even the discrete normal approximation bounds seem to be new. The general result follows from Stein's method, and requires a new bound on the Stein solution for the Poisson distribution, which is of general interest., Comment: Ver2: 28 pages, minor revision; Ver1: 27 pages

The Aldous gossip process represents the dissemination of information in geographical space as a process of locally deterministic spread, augmented by random long range transmissions. Starting from a single initially informed individual, the proportion of individuals informed follows an almost deterministic path, but for a random time shift, caused by the stochastic behaviour in the very early stages of development. In this paper, it is shown that, even with the extra information available after a substantial development time, this broad description remains accurate to first order. However, the precision of the prediction is now much greater, and the random time shift is shown to have an approximately normal distribution, with mean and variance that can be computed from the current state of the process.

The paper applies the theory developed in Part I to the discrete normal approximation in total variation of random vectors in ${\mathbb Z}^d$. We illustrate the use of the method for sums of independent integer valued random vectors, and for random vectors exhibiting an exchangeable pair. We conclude with an application to random colourings of regular graphs., Comment: arXiv:1512.07400 has been split into two parts: this is Part II

For integer valued random variables, the translated Poisson distributions form a flexible family for approximation in total variation, in much the same way that the normal family is used for approximation in Kolmogorov distance. Using the Stein--Chen method, approximation can often be achieved with error bounds of the same order as those for the CLT. In this paper, an analogous theory, again based on Stein's method, is developed in the multivariate context. The approximating family consists of the equilibrium distributions of a collection of Markov jump processes, whose analogues in one dimension are the immigration--death processes with Poisson distributions as equilibria. The method is illustrated by providing total variation error bounds for the approximation of the equilibrium distribution of one Markov jump process by that of another. In a companion paper, it is shown how to use the method for discrete normal approximation in ${\mathbb Z}^d$., Comment: 57 pages. This paper and 1612.07519 together replace an earlier, longer version

The paper presents a phenomenon occurring in population processes that start near zero and have large carrying capacity. By the classical result of Kurtz~(1970), such processes, normalized by the carrying capacity, converge on finite intervals to the solutions of ordinary differential equations, also known as the fluid limit. When the initial population is small relative to carrying capacity, this limit is trivial. Here we show that, viewed at suitably chosen times increasing to infinity, the process converges to the fluid limit, governed by the same dynamics, but with a random initial condition. This random initial condition is related to the martingale limit of an associated linear birth and death process.

The paper presents a general introduction to the astonishing method for deriving probability approximations that was invented by Charles Stein around 50 years ago.

Density dependent Markov population processes with countably many types can often be well approximated over finite time intervals by the solution of the differential equations that describe their average drift, provided that the total population size is large. They also exhibit diffusive stochastic fluctuations on a smaller scale about this deterministic path. Here, it is shown that the individuals in such processes experience an almost deterministic environment. Small groups of individuals behave almost independently of one another, evolving as Markov jump processes, whose transition rates are prescribed functions of time. In the context of metapopulation models, we show that `individuals' can represent either patches or the individuals that migrate among the patches; in host--parasite systems, they can represent both hosts and parasites., Comment: 27 pages

We consider the motion of a particle on a Galton Watson tree, when the probabilities of jumping from a vertex to any one of its neighbours is determined by a random process. Given the tree, positive weights are assigned to the edges in such a way that, viewed along any line of descent, they evolve as a random process. In order to introduce our method for proving transience or recurrence, we first suppose that the weights are i.i.d., reproving a result of Lyons and Pemantle. We then extend the argument to allow a Markovian environment, and finally to a random walk on a Markovian environment that changes the environment. Our approach involves studying the typical behaviour of processes on fixed lines of descent, which we then show determines the behaviour of the process on the whole tree., Comment: 22 Pages

In this paper, we study the relationship between certain stochastic and deterministic versions of Hanski's incidence function model and the spatially realistic Levins model. We show that the stochastic version can be well approximated in a certain sense by the deterministic version when the number of habitat patches is large, provided that the presence or absence of individuals in a given patch is influenced by a large number of other patches. Explicit bounds on the deviation between the stochastic and deterministic models are given., Comment: The final publication is available at Springer via http://dx.doi.org/10.1007/s00285-015-0865-4

Density dependent Markov population processes in large populations of size $N$ were shown by Kurtz (1970, 1971) to be well approximated over finite time intervals by the solution of the differential equations that describe their average drift, and to exhibit stochastic fluctuations about this deterministic solution on the scale $\sqrt N$ that can be approximated by a diffusion process. Here, motivated by an example from evolutionary biology, we are concerned with describing how such a process leaves an absorbing boundary. Initially, one or more of the populations is of size much smaller than $N$, and the length of time taken until all populations have sizes comparable to $N$ then becomes infinite as $N \to \infty$. Under suitable assumptions, we show that in the early stages of development, up to the time when all populations have sizes at least $N^{1-\alpha}$, for $1/3 < \alpha < 1$, the process can be accurately approximated in total variation by a Markov branching process. Thereafter, the process is well approximated by the deterministic solution starting from the original initial point, but with a random time delay. Analogous behaviour is also established for a Markov process approaching an equilibrium on a boundary, where one or more of the populations become extinct., Comment: 50 pages

The paper gives the bounds on the solutions to a Stein equation for the negative binomial distribution that are needed for approximation in terms of the Wasserstein metric. The proofs are probabilistic, and follow the approach introduced in Barbour and Xia (Bernoulli 12 (2006) 943-954). The bounds are used to quantify the accuracy of negative binomial approximation to parasite counts in hosts. Since the infectivity of a population can be expected to be proportional to its total parasite burden, the Wasserstein metric is the appropriate choice., Comment: Published at http://dx.doi.org/10.3150/14-BEJ595 in the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

Many models of epidemic spread have a common qualitative structure. The numbers of infected individuals during the initial stages of an epidemic can be well approximated by a branching process, after which the proportion of individuals that are susceptible follows a more or less deterministic course. In this paper, we show that both of these features are consequences of assuming a locally branching structure in the models, and that the deterministic course can itself be determined from the distribution of the limiting random variable associated with the backward, susceptibility branching process. Examples considered include a stochastic version of the Kermack & McKendrick model, the Reed-Frost model, and the Volz configuration model., Comment: 34 pages

Both small world models of random networks with occasional long range connections and gossip processes with occasional long range transmission of information have similar characteristic behaviour. The long range elements appreciably reduce the effective distances, measured in space or in time, between pairs of typical points. In this paper, we show that their common behaviour can be interpreted as a product of the locally branching nature of the models. In particular, it is shown that both typical distances between points and the proportion of space that can be reached within a given distance or time can be approximated by formulae involving the limit random variable of the branching process., Comment: 30 pages

When modelling metapopulation dynamics, the influence of a single patch on the metapopulation depends on the number of individuals in the patch. Since there is usually no obvious natural upper limit on the number of individuals in a patch, this leads to systems in which there are countably infinitely many possible types of entity. Analogous considerations apply in the transmission of parasitic diseases. In this paper, we prove central limit theorems for quite general systems of this kind, together with bounds on the rate of convergence in an appropriately chosen weighted $\ell_1$ norm., Comment: 24 pages

Quasi-stationary distributions, as discussed by Darroch & Seneta (1965), have been used in biology to describe the steady state behaviour of population models which, while eventually certain to become extinct, nevertheless maintain an apparent stochastic equilibrium for long periods. These distributions have some drawbacks: they need not exist, nor be unique, and their calculation can present problems. In an earlier paper, we gave biologically plausible conditions under which the quasi-stationary distribution is unique, and can be closely approximated by distributions that are simple to compute. In this paper, we consider conditions under which the quasi-stationary distribution, if it exists, need not be unique, but an apparent stochastic equilibrium can nonetheless be identified and computed; we call such a distribution a quasi-equilibrium distribution., Comment: 22 pages

When approximating the joint distribution of the component counts of a decomposable combinatorial structure that is `almost' in the logarithmic class, but nonetheless has irregular structure, it is useful to be able first to establish that the distribution of a certain sum of non-negative integer valued random variables is smooth. This distribution is not like the normal, and individual summands can contribute a non-trivial amount to the whole, so its smoothness is somewhat surprising. In this paper, we consider two coupling approaches to establishing the smoothness, and contrast the results that are obtained., Comment: 9 pages

Quasi-logarithmic combinatorial structures are a class of decomposable combinatorial structures which extend the logarithmic class considered by Arratia, Barbour and Tavar\'{e} (2003). In order to obtain asymptotic approximations to their component spectrum, it is necessary first to establish an approximation to the sum of an associated sequence of independent random variables in terms of the Dickman distribution. This in turn requires an argument that refines the Mineka coupling by incorporating a blocking construction, leading to exponentially sharper coupling rates for the sums in question. Applications include distributional limit theorems for the size of the largest component and for the vector of counts of the small components in a quasi-logarithmic combinatorial structure., Comment: 22 pages; replaces earlier paper [arXiv:math/0609129] with same title by Bruno Nietlispach

An information-theoretic development is given for the problem of compound Poisson approximation, which parallels earlier treatments for Gaussian and Poisson approximation. Let $P_{S_n}$ be the distribution of a sum $S_n=\Sumn Y_i$ of independent integer-valued random variables $Y_i$. Nonasymptotic bounds are derived for the distance between $P_{S_n}$ and an appropriately chosen compound Poisson law. In the case where all $Y_i$ have the same conditional distribution given $\{Y_i\neq 0\}$, a bound on the relative entropy distance between $P_{S_n}$ and the compound Poisson distribution is derived, based on the data-processing property of relative entropy and earlier Poisson approximation results. When the $Y_i$ have arbitrary distributions, corresponding bounds are derived in terms of the total variation distance. The main technical ingredient is the introduction of two "information functionals," and the analysis of their properties. These information functionals play a role analogous to that of the classical Fisher information in normal approximation. Detailed comparisons are made between the resulting inequalities and related bounds., Comment: 27 pages

The dynamics of tumour evolution are not well understood. In this paper we provide a statistical framework for evaluating the molecular variation observed in different parts of a colorectal tumour. A multi-sample version of the Ewens Sampling Formula forms the basis for our modelling of the data, and we provide a simulation procedure for use in obtaining reference distributions for the statistics of interest. We also describe the large-sample asymptotics of the joint distributions of the variation observed in different parts of the tumour. While actual data should be evaluated with reference to the simulation procedure, the asymptotics serve to provide theoretical guidelines, for instance with reference to the choice of possible statistics., Comment: 22 pages, 1 figure. Chapter 4 of "Probability and Mathematical Genetics: Papers in Honour of Sir John Kingman" (Editors N.H. Bingham and C.M. Goldie), Cambridge University Press, 2010

Quasi-stationary distributions, as discussed by Darroch & Seneta (1965), have been used in biology to describe the steady state behaviour of population models which, while eventually certain to become extinct, nevertheless maintain an apparent stochastic equilibrium for long periods. These distributions have some drawbacks: they need not exist, nor be unique, and their calculation can present problems. In this paper, we give biologically plausible conditions under which the quasi-stationary distribution is unique, and can be closely approximated by distributions that are simple to compute., Comment: 16 pages

Using an associated branching process as the basis of our approximation, we show that typical inter-point distances in a multitype random intersection graph have a defective distribution, which is well described by a mixture of translated and scaled Gumbel distributions, the missing mass corresponding to the event that the vertices are not in the same component of the graph., Comment: 32 pages

When modelling metapopulation dynamics, the influence of a single patch on the metapopulation depends on the number of individuals in the patch. Since the population size has no natural upper limit, this leads to systems in which there are countably infinitely many possible types of individual. Analogous considerations apply in the transmission of parasitic diseases. In this paper, we prove a law of large numbers for rather general systems of this kind, together with a rather sharp bound on the rate of convergence in an appropriately chosen weighted $\ell_1$ norm., Comment: revised version in response to referee comments, 34 pages

In this paper, we consider approximating expansions for the distribution of integer valued random variables, in circumstances in which convergence in law cannot be expected. The setting is one in which the simplest approximation to the $n$'th random variable $X_n$ is by a particular member $R_n$ of a given family of distributions, whose variance increases with $n$. The basic assumption is that the ratio of the characteristic function of $X_n$ and that of R_n$ converges to a limit in a prescribed fashion. Our results cover a number of classical examples in probability theory, combinatorics and number theory.

The paper establishes a functional version of the Hoeffding combinatorial central limit theorem. First, a pre-limiting Gaussian process approximation is defined, and is shown to be at a distance of the order of the Lyapounov ratio from the original random process. Distance is measured by comparison of expectations of smooth functionals of the processes, and the argument is by way of Stein's method. The pre-limiting process is then shown, under weak conditions, to converge to a Gaussian limit process. The theorem is used to describe the shape of random permutation tableaux., Comment: 23 pages

The paper is concerned with the equilibrium distribution $\Pi_n$ of the $n$-th element in a sequence of continuous-time density dependent Markov processes on the integers. Under a $(2+\a)$-th moment condition on the jump distributions, we establish a bound of order $O(n^{-(\a+1)/2}\sqrt{\log n})$ on the difference between the point probabilities of $\Pi_n$ and those of a translated Poisson distribution with the same variance. Except for the factor $\sqrt{\log n}$, the result is as good as could be obtained in the simpler setting of sums of independent integer-valued random variables. Our arguments are based on the Stein-Chen method and coupling., Comment: 19 pages

The paper is concerned with the equilibrium distributions of continuous-time density dependent Markov processes on the integers. These distributions are known typically to be approximately normal, and the approximation error, as measured in Kolmogorov distance, is of the smallest order that is compatible with their having integer support. Here, an approximation in the much stronger total variation norm is established, without any loss in the asymptotic order of accuracy; the approximating distribution is a translated Poisson distribution having the same variance and (almost) the same mean. Our arguments are based on the Stein-Chen method and Dynkin's formula., Comment: 18 pages

The paper concerns the classical occupancy scheme with infinitely many boxes. We establish approximations to the distributions of the number of occupied boxes, and of the number of boxes containing exactly r balls, within the family of translated Poisson distributions. These are shown to be of ideal asymptotic order, with respect both to total variation distance and to the approximation of point probabilities. The proof is probabilistic, making use of a translated Poisson approximation theorem of R\"ollin (2005)., Comment: 20 pages

The paper is concerned with approximating the distribution of a sum W of n integer valued random variables Y_i, whose distributions depend on the state of an underlying Markov chain X. The approximation is in terms of a translated Poisson distribution, with mean and variance chosen to be close to those of W, and the error is measured with respect to the total variation norm. Error bounds comparable to those found for normal approximation with respect to the weaker Kolmogorov distance are established, provided that the distribution of the sum of the Y_i's between the successive visits of X to a reference state is aperiodic. Without this assumption, approximation in total variation cannot be expected to be good., Comment: 25 pages. Corrected version of Journal of Theoretical Probability 19, 609-630 (2006): both statement and proof of Lemma 4.1 have been altered

The paper is concerned with the classical occupancy scheme with infinitely many boxes, in which $n$ balls are thrown independently into boxes $1,2,...$, with probability $p_j$ of hitting the box $j$, where $p_1\geq p_2\geq...>0$ and $\sum_{j=1}^\infty p_j=1$. We establish joint normal approximation as $n\to\infty$ for the numbers of boxes containing $r_1,r_2,...,r_m$ balls, standardized in the natural way, assuming only that the variances of these counts all tend to infinity. The proof of this approximation is based on a de-Poissonization lemma. We then review sufficient conditions for the variances to tend to infinity. Typically, the normal approximation does not mean convergence. We show that the convergence of the full vector of $r$-counts only holds under a condition of regular variation, thus giving a complete characterization of possible limit correlation structures.

In modeling parasitic diseases, it is natural to distinguish hosts according to the number of parasites that they carry, leading to a countably infinite type space. Proving the analogue of the deterministic equations, used in models with finitely many types as a "law of large numbers" approximation to the underlying stochastic model, has previously either been done case by case, using some special structure, or else not attempted. In this paper we prove a general theorem of this sort, and complement it with a rate of convergence in the $\ell_1$-norm., Comment: Published in at http://dx.doi.org/10.1214/08-AAP521 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Branching process approximation to the initial stages of an epidemic process has been used since the 1950's as a technique for providing stochastic counterparts to deterministic epidemic threshold theorems. One way of describing the approximation is to construct both branching and epidemic processes on the same probability space, in such a way that their paths coincide for as long as possible. In this paper, it is shown, in the context of a Markovian model of parasitic infection, that coincidence can be achieved with asymptotically high probability until o(N^{2/3}) infections have occurred, where N denotes the total number of hosts., Comment: 16 pages

Stein's (1972) method is a very general tool for assessing the quality of approximation of the distribution of a random element by another, often simpler, distribution. In applications of Stein's method, one needs to establish a Stein identity for the approximating distribution, solve the Stein equation and estimate the behaviour of the solutions in terms of the metrics under study. For some Stein equations, solutions with good properties are known; for others, this is not the case. Barbour and Xia (1999) introduced a perturbation method for Poisson approximation, in which Stein identities for a large class of compound Poisson and translated Poisson distributions are viewed as perturbations of a Poisson distribution. In this paper, it is shown that the method can be extended to very general settings, including perturbations of normal, Poisson, compound Poisson, binomial and Poisson process approximations in terms of various metrics such as the Kolmogorov, Wasserstein and total variation metrics. Examples are provided to illustrate how the general perturbation method can be applied., Comment: 34 pages