Search

It has been for a long time to use big data of autonomous vehicles for perception, prediction, planning, and control of driving. Naturally, it is increasingly questioned why not using this big data for risk management and actuarial modeling. This article examines the emerging technical difficulties, new ideas, and methods of risk modeling under autonomous driving scenarios. Compared with the traditional risk model, the novel model is more consistent with the real road traffic and driving safety performance. More importantly, it provides technical feasibility for realizing risk assessment and car insurance pricing under a computer simulation environment., Comment: 11 pages, 5 figures, IME 2021

There are known expressions to calculate the moments of the first passage time in Markov chains. Nevertheless, it is commonly forgotten that in most applications the parameters of the Markov chain are constructed using estimates based upon empirical data and in those cases the data sample size should play an important role in estimating the variance. Here we provide a Monte Carlo approach to estimate the first two moments of the passage time in this situation. We illustrate this method with an example using data from the biological field.

We consider linear reaction systems with slow and fast reactions, which can be interpreted as master equations or Kolmogorov forward equations for Markov processes on a finite state space. We investigate their limit behavior if the fast reaction rates tend to infinity, which leads to a coarse-grained model where the fast reactions create microscopically equilibrated clusters, while the exchange mass between the clusters occurs on the slow time scale. Assuming detailed balance the reaction system can be written as a gradient flow with respect to the relative entropy. Focusing on the physically relevant cosh-type gradient structure we show how an effective limit gradient structure can be rigorously derived and that the coarse-grained equation again has a cosh-type gradient structure. We obtain the strongest version of convergence in the sense of the Energy-Dissipation Principle (EDP), namely EDP-convergence with tilting., Comment: This version corrects the previously wrong statement in Lemma 3.4

We generalize the evolution model introduced by Guiol, Machado and Schinazi (2010). In our model at odd times a random number X of species is created. Each species is endowed with a random fitness with arbitrary distribution on $[0, 1]$. At even times a random number Y of species is removed, killing the species with lower fitness. We show that there is a critical fitness $f_c$ below which the number of species hits zero i.o. and above of which this number goes to infinity. We prove uniform convergence for the distribution of surviving species and describe the phenomena which could not be observed in previous works with uniformly distributed fitness., Comment: 14 pages, some minor mistakes have been fixed

Nous etudions un processus d’Ising avec contraintes cinetiques (PICC) associe a un graphe $G$ et un parametre de densite $p$. Ce processus est un systeme de particules en interaction avec espace d’etats $\Omega=\{0,1\}^{G}$, decrivant les positions des particules. Les « contraintes » apparaissant dans le nom de ce processus referent a la regle suivante: un sommet ne peut pas changer son etat a moins qu’il ait un voisin dans l’etat « 1 ». Le PICC a ete propose par des physiciens comme un modele pour la transition vitreuse. Dans ce travail, nous analysons le temps de melange d’un PICC sur le tore de dimension 2 $G=\mathbb{Z}_{L}^{2}$ dans le regime de faible densite $p=\frac{c}{L^{2}}$, ou $0

We study the Markov semigroups for two important algorithms from machine learning: stochastic gradient descent (SGD) and online principal component analysis (PCA). We investigate the effects of small jumps on the properties of the semi-groups. Properties including regularity preserving, $L^{\infty}$ contraction are discussed. These semigroups are the dual of the semigroups for evolution of probability, while the latter are $L^{1}$ contracting and positivity preserving. Using these properties, we show that stochastic differential equations (SDEs) in $\mathbb{R}^d$ (on the sphere $\mathbb{S}^{d-1}$) can be used to approximate SGD (online PCA) weakly. These SDEs may be used to provide some insights of the behaviors of these algorithms.

Markov Chains offer ideal conditions for the study and mathematical modelling of a certain kind of situations depending on random variables. The basic concepts of the corresponding theory were introduced by Markov in 1907 on coding literary texts. Since then, the Markov Chain theory was developerd by a number of leading mathematicians, such as Kolmogorov, Feller etc. However, only from the 1960's the importance of this theory to the Natural, Social and most of the other Applied Sciences has been recognized. In this review paper we present applications of finite Markov Chains to management problems, which can be solved, as most of the problems concerning applications of Markov chains in general do, by distinguishing between two types of Chains, the Ergodic and the Absorbing ones., Comment: 10 pages, 1 figure, 18 references

The Prisoner's Dilemma Process on a graph $G$ is an iterative process where each vertex, with a fixed strategy (cooperate or defect), plays the game with each of its neighbours. At the end of a round each vertex may change its strategy to that of its neighbour with the highest pay-off. Here we study the spread of cooperative and selfish behaviours on a toroidal grid, where each vertex is initially a cooperator with probability $p$. When vertices are permitted to change their strategies via a randomized asynchronous update scheme, we find that for some values of $p$ the limiting density of cooperators may be modelled as a polynomial in $p$. Theoretical bounds for this density are confirmed via simulation.

The binding of molecules, ions or proteins to specific target sites is a generic step for cell activation. However, this step relies on rare events where stochastic particles located in a large bulk are searching for small and often hidden targets and thus remains difficult to study. We present here a hybrid discrete-continuum model where the large ensemble of particles is described by mass-action laws. The rare discrete binding events are modeled by a Markov chain for the encounter of a finite number of small targets by few Brownian particles, for which the arrival time is Poissonian. This model is applied for predicting the time distribution of vesicular release at neuronal synapses that remains elusive. This release is triggered by the binding of few calcium ions that can originate either from the synaptic bulk or from the transient entry through calcium channels. We report that the distribution of release time is bimodal although triggered by a single fast action potential: while the first peak follows a stimulation, the second corresponds to the random arrival over much longer time of ions located in the bulk to small binding targets. To conclude, the present multiscale stochastic chemical reaction modeling allows studying cellular events based on integrating discrete molecular events over various time scales., Comment: 4 pages (submitted)

The Random Walk Metropolis (RWM) algorithm is a Metropolis- Hastings MCMC algorithm designed to sample from a given target distribution \pi with Lebesgue density on R^N. RWM constructs a Markov chain by randomly proposing a new position (the "proposal move"), which is then accepted or rejected according to a rule which makes the chain reversible with respect to \pi. When the dimension N is large a key question is to determine the optimal scaling with N of the proposal variance: if the proposal variance is too large, the algorithm will reject the proposed moves too often; if it is too small, the algorithm will explore the state space too slowly. Determining the optimal scaling of the proposal variance gives a measure of the cost of the algorithm as well. One approach to tackle this issue, which we adopt here, is to derive diffusion limits for the algorithm. Such an approach has been proposed in the seminal papers [RGG97, RR98]; in particular in [RGG97] the authors derive a diffusion limit for the RWM algorithm under the two following assumptions: i) the algorithm is started in stationarity; ii) the target measure $\pi$ is in product form. The present paper considers the situation of practical interest in which both assumptions i) and ii) are removed. That is a) we study the case (which occurs in practice) in which the algorithm is started out of stationarity and b) we consider target measures which are in non-product form. The target measures that we consider arise in Bayesian nonparametric statistics and in the study of conditioned diffusions. We prove that, out of stationarity, the optimal scaling for the proposal variance is O(N), as it is in stationarity. Notice that the optimal scaling in and out of stationatity need not be the same in general, and indeed they differ e.g. in the case of the MALA algorithm [KOS16]., Comment: 53 pages, 4 figure

We consider a vertex reinforced random walk on the integer lattice with sub-linear reinforcement. Under some assumptions on the regular variation of the weight function, we characterize whether the walk gets stuck on a finite interval. When this happens, we estimate the size of the localization set. In particular, we show that, for any odd number $N$ larger than or equal to 5, there exists a vertex reinforced random walk which localizes with positive probability on exactly $N$ consecutive sites., Comment: Minor modifications

It was widely reported in the media that, on 23 May 2009, at the Borgata Hotel Casino & Spa in Atlantic City, Patricia DeMauro, playing craps for only the second time, rolled the dice for four hours and 18 minutes, finally sevening out at the 154th roll, a world record. Initial estimates of the probability of this event were erroneous, but consensus was reached within days: one chance in 5.6 billion. More generally, what is P(L \ge n), where the random variable L denotes the length of the shooter's hand (154 in Ms. DeMauro's case) and n is a positive integer? It is well known that these probabilities can be derived recursively or by Markov chain methods. Our aim here is to give an explicit closed-form expression for them, showing that the distribution of L is a linear combination (not a convex combination) of four geometric distributions., 5 pages; slight revision of original

We introduce a new class of dynamic point process models with simple and intuitive dynamics that are based on the Voronoi tessellations generated by the processes. Under broad conditions, these processes prove to be ergodic and produce, on stabilisation, a wide range of clustering patterns. In the paper, we present results of simulation studies of three statistical measures (Thiel's redundancy, van Lieshout and Baddeley's $J$-function and the empirical distribution of the Voronoi nearest neighbours' numbers) for inference on these models from the clustering behaviour in the stationary regime. In particular, we make comparisons with the area-interaction processes of Baddeley and van Lieshout., Comment: 11 pages, 10 figures

Iteration of randomly chosen quadratic maps defines a Markov process: X_{n+1}=\epsilon_{n+1}X_n(1-X_n), where \epsilon_n are i.i.d. with values in the parameter space [0,4] of quadratic maps F_{\theta}(x)=\theta x(1-x). Its study is of significance as an important Markov model, with applications to problems of optimization under uncertainty arising in economics. In this article a broad criterion is established for positive Harris recurrence of X_n., Comment: Published at http://dx.doi.org/10.1214/105051604000000918 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)