Search

In this paper we study the stability of queueing systems with impatient customers and a single server operating under a FIFO (first-in-first-out) discipline. We first give a sufficient condition for the existence of a stationary workload in the case of impatience until the beginning of service. We then provide a weaker condition of existence on an enriched probability space using the theory of Anantharam et al. (1997), (1999). The case of impatience until the end of service is also investigated.

In this paper we propose a general bivariate random effect model with special emphasis on frailty models and environmental effect models, and present some stochastic comparisons. The relationship between the conditional and the unconditional hazard gradients are derived and some examples are provided. We investigate how the well-known stochastic orderings between the distributions of two frailties translate into the orderings between the corresponding survival functions. These results are used to obtain the properties of the bivariate multiplicative model and the shared frailty model.

The aim of this paper is to study the stochastic monotonicity and continuity properties of the extinction time of Bellman-Harris branching processes depending on their reproduction laws. Moreover, we show their applications in an epidemiological context, obtaining an optimal criterion to establish the proportion of susceptible individuals in a given population that must be vaccinated in order to eliminate an infectious disease. First the spread of infection is modelled by a Bellman-Harris branching process. Finally, we provide a simulation-based method to determine the optimal vaccination policies.

In this paper we obtain an approximation for the duration distribution of the excursion set generated by the minimum of two independent F random processes above a high threshold u. Moreover, we obtain a closed-form approximation for the mean duration of the conjunction of these two F processes. As an illustration, we conduct a simulation study to compare the performances of the approximated distribution and the exact distribution.

System signatures are useful tools in the study and comparison of coherent systems. In this paper, we define and study a similar concept, called the joint signature, for two coherent systems which share some components. Under an independent and identically distributed assumption on component lifetimes, a pseudo-mixture representation based on this joint signature is obtained for the joint distribution of the lifetimes of both systems. Sufficient conditions are given based on the respective joint signatures of two pairs of systems, each with shared components, to ensure various forms of bivariate stochastic orderings between the joint lifetimes of the two pairs of systems. The present investigation is focused on the joint behavior of pairs of systems which have one or more shared components. Our main goal is to characterize the joint (bivariate) distribution of the lifetimes T\ and T2 of the two systems. Our approach involves the expansion of the scope of the theory of system signatures. We will develop representation results for the joint distribution G(t\, t2) = P(T\ < t\, T2 < t2) in terms of the newly defined joint signature of the two systems. Before reviewing the characteristics of system signatures in the univariate case that will be relevant to the present study, and before we proceed with the development of joint signatures and their applications, we will begin with a brief discussion of the type of systems and scenarios from which the present work is motivated. A frequently encountered example of systems with shared components occurs in networked computing in which a server (say a file server or Web server) is used in tandem with several individual computers. It is typical that departments within a company or university will store almost all of the files for the department's individual PCs on one central server. If the central server goes down, the PCs with local disks may retain certain limited capabilities, while other PCs may not work at all. The performance of any given pair of PCs will depend on the

In a two-person red-and-black game, each player holds an integral amount of chips. At each stage of the game, each player can bet any integral amount in his possession, winning the chips of his opponent with a probability which is a function of the ratio of his bet to the sum of both players' bets and is called a win probability function. Both players seek to maximize the probability of winning the entire fortune of his opponent. In this paper we propose two new models. In the first model, at each stage, there is a positive probability that two players exchange their bets. In the second model, the win probability functions are stage dependent. In both models, we obtain suitable conditions on the win probability functions such that it is a Nash equilibrium for the subfair player to play boldly and for the superfair player to play timidly.

In this paper we propose a framework that facilitates the study of large deviations for point processes based on stationary sequences with regularly varying tails. This framework allows us to keep track both of the magnitude of the extreme values of a process and the order in which these extreme values appear. Particular emphasis is put on (infinite) linear processes with random coefficients. The proposed framework provides a fairly complete description of the joint asymptotic behavior of the large values of the stationary sequence. We apply the general result on large deviations for point processes to derive the asymptotic decay of certain probabilities related to partial sum processes as well as ruin probabilities.

The inverse stochastic dominance of degree r is a stochastic order of interest in several branches of economics. We discuss it in depth, the central point being the characterization in terms of the weak r-majorization of the vectors of expected order statistics. The weak r-majorization (a notion introduced in the paper) is a natural extension of the classical (reverse) weak majorization of Hardy, Littlewood and Pòlya. This work also shows the equivalence between the continuous majorization (of higher order) and the discrete r-majorization. In particular, our results make it clear that the cases r = 1, 2 differ substantially from those with r ≥ 3, a fact observed earlier by Muliere and Scarsini (1989), among other authors. Motivated by this fact, we introduce new stochastic orderings, as well as new social inequality indices to compare the distribution of the wealth in two populations, which could be considered as natural extensions of the first two dominance rules and the S-Gini indices, respectively.

With (Q t ) t denoting the stationary workload process in a queue fed by a Lévy input process (X t ) t , this paper focuses on the asymptotics of rare event probabilities of the type P(Q 0 > pB, Q T B > qB) for given positive numbers p and q, and a positive deterministic function T B . We first identify conditions under which the probability of interest is dominated by the ‘most demanding event’, in the sense that it is asymptotically equivalent to P(Q > max{p, q}B) for large B, where Q denotes the steady-state workload. These conditions essentially reduce to T B being sublinear (i.e. T B /B → 0 as B → ∞). A second condition is derived under which the probability of interest essentially ‘decouples’, in that it is asymptotically equivalent to P(Q > pB)P(Q > qB) for large B. For various models considered in the literature, this ‘decoupling condition’ reduces to requiring that T B is superlinear (i.e. T B / B → ∞ as B → ∞). This is not true for certain ‘heavy-tailed’ cases, for instance, the situations in which the Lévy input process corresponds to an α-stable process, or to a compound Poisson process with regularly varying job sizes, in which the ‘decoupling condition’ reduces to T B / B 2 → ∞. For these input processes, we also establish the asymptotics of the probability under consideration for T B increasing superlinearly but subquadratically. We pay special attention to the case T B = RB for some R > 0; for light-tailed input, we derive intuitively appealing asymptotics, intensively relying on sample path large deviations results. The regimes obtained can be interpreted in terms of the most likely paths to overflow.

The tail dependence of multivariate distributions is frequently studied via the tool of copulas. In this paper we develop a general method, which is based on multivariate regular variation, to evaluate the tail dependence of heavy-tailed scale mixtures of multivariate distributions, whose copulas are not explicitly accessible. Tractable formulae for tail dependence parameters are derived, and a sufficient condition under which the parameters are monotone with respect to the heavy tail index is obtained. The multivariate elliptical distributions are discussed to illustrate the results.

A model for describing the lifetimes of coherent systems, where the failures of components may have an impact on the lifetimes of the remaining components, is proposed. The model is motivated by the definition of sequential order statistics (cf. Kamps (1995)). Sequential order statistics describe the successive failure times in a sequential k-out-of-n system, where the distribution of the remaining components' lifetimes is allowed to change after every failure of a component. In the present paper, general component lifetimes which can be influenced by failures are considered. The ordered failure times of these components can be used to extend the concept of sequential order statistics. In particular, a definition of sequential order statistics based on exchangeable components is proposed. By utilizing the system signature (cf. Samaniego (2007)), the distribution of the lifetime of a coherent system with failure-dependent exchangeable component lifetimes is shown to be given by a mixture of the distributions of sequential order statistics. Furthermore, some results on the joint distribution of sequential order statistics based on exchangeable components are given.

The tail dependence of multivariate distributions is frequently studied via the tool of copulas. In this paper we develop a general method, which is based on multivariate regular variation, to evaluate the tail dependence of heavy-tailed scale mixtures of multivariate distributions, whose copulas are not explicitly accessible. Tractable formulae for tail dependence parameters are derived, and a sufficient condition under which the parameters are monotone with respect to the heavy tail index is obtained. The multivariate elliptical distributions are discussed to illustrate the results.

In this paper we study a generalized Pólya urn with balls of two colors and a random triangular replacement matrix. We extend some results of Janson (2004), (2005) to the case where the largest eigenvalue of the mean of the replacement matrix is not in the dominant class. Using some useful martingales and the embedding method introduced in Athreya and Karlin (1968), we describe the asymptotic composition of the urn after the nth draw, for large n.

In this paper, a stochastic integral of Ornstein–Uhlenbeck type is represented to be the sum of two independent random variables: one has a tempered stable distribution and the other has a compound Poisson distribution. In distribution, the compound Poisson random variable is equal to the sum of a Poisson-distributed number of positive random variables, which are independent and identically distributed and have a common specified density function. Based on the representation of the stochastic integral, we prove that the transition distribution of the tempered stable Ornstein–Uhlenbeck process is self-decomposable and that the transition density is a C∞-function.

Let X be a pure-jump subordinator (i.e. nondecreasing Lévy process with no drift) with infinite Lévy measure, let X ε be the sum of jumps not exceeding ε, and let µ(ε)=E[X ε(1)]. We study the question of weak convergence of X ε/µ(ε) as ε ↓0, in terms of the limit behavior of µ(ε)/ε. The most interesting case reduces to the weak convergence of X ε/ε to a subordinator whose marginals are generalized Dickman distributions; we give some necessary and sufficient conditions for this to hold. For a certain significant class of subordinators for which the latter convergence holds, and whose most prominent representative is the gamma process, we give some detailed analysis regarding the convergence quality (in particular, in the context of approximating X itself). This paper completes, in some respects, the study made by Asmussen and Rosiński (2001).

In this paper we consider two classes of reflected Ornstein–Uhlenbeck (OU) processes: the reflected OU process with jumps and the Markov-modulated reflected OU process. We prove that their stationary distributions exist. Furthermore, for the jump reflected OU process, the Laplace transform (LT) of the stationary distribution is given. As for the Markov-modulated reflected OU process, we derive an equation satisfied by the LT of the stationary distribution.

In this paper we consider the following problem. An angler buys a fishing ticket that allows him/her to fish for a fixed time. There are two locations to fish at the lake. The fish are caught according to a renewal process, which is different for each fishing location. The angler's success is defined as the difference between the utility function, which is dependent on the size of the fish caught, and the time-dependent cost function. These functions are different for each fishing location. The goal of the angler is to find two optimal stopping times that maximize his/her success: when to change fishing location and when to stop fishing. Dynamic programming methods are used to find these two optimal stopping times and to specify the expected success of the angler at these times.

In this paper we prove that a sequence of scaled generalized Jiřina processes can converge weakly to a nonlinear diffusion process with Lévy jumps under certain conditions.

In this paper we generalize existing results for the steady-state distribution of growth-collapse processes. We begin with a stationary setup with some relatively general growth process and observe that, under certain expected conditions, point- and time-stationary versions of the processes exist as well as a limiting distribution for these processes which is independent of initial conditions and necessarily has the marginal distribution of the stationary version. We then specialize to the cases where an independent and identically distributed (i.i.d.) structure holds and where the growth process is a nondecreasing Lévy process, and in particular linear, and the times between collapses form an i.i.d. sequence. Known results can be seen as special cases, for example, when the inter-collapse times form a Poisson process or when the collapse ratio is deterministic. Finally, we comment on the relation between these processes and shot-noise type processes, and observe that, under certain conditions, the steady-state distribution of one may be directly inferred from the other.

In extreme shock models, only the impact of the current, possibly fatal shock is usually taken into account, whereas in cumulative shock models, the impact of the preceding shocks is accumulated as well. In this paper we combine an extreme shock model with a specific cumulative shock model. It is shown that the proposed setting can also be interpreted as a generalization of the well-known Brown–Proschan model that describes repair actions for repairable systems. For a system subject to a specific process of shocks, we derive the survival probability and the corresponding failure rate function. Some meaningful interpretations and examples are discussed.

Chiu and Yin (2005) found the Laplace transform of the last time a spectrally negative Lévy process, which drifts to ∞, is below some level. The main motivation for the study of this random time stems from risk theory: what is the last time the risk process, modeled by a spectrally negative Lévy process drifting to ∞, is 0? In this paper we extend the result of Chiu and Yin, and we derive the Laplace transform of the last time, before an independent, exponentially distributed time, that a spectrally negative Lévy process (without any further conditions) exceeds (upwards or downwards) or hits a certain level. As an application, we extend a result found in Doney (1991).

In Lyons, Pemantle and Peres (1995), a martingale change of measure method was developed in order to give an alternative proof of the Kesten–Stigum L log L theorem for single-type branching processes. Later, this method was extended to prove the L log L theorem for multiple- and general multiple-type branching processes in Biggins and Kyprianou (2004), Kurtz et al. (1997), and Lyons (1997). In this paper we extend this method to a class of superdiffusions and establish a Kesten–Stigum L log L type theorem for superdiffusions. One of our main tools is a spine decomposition of superdiffusions, which is a modification of the one in Englander and Kyprianou (2004).

Chiu and Yin (2005) found the Laplace transform of the last time a spectrally negative Lévy process, which drifts to ∞, is below some level. The main motivation for the study of this random time stems from risk theory: what is the last time the risk process, modeled by a spectrally negative Lévy process drifting to ∞, is 0? In this paper we extend the result of Chiu and Yin, and we derive the Laplace transform of the last time, before an independent, exponentially distributed time, that a spectrally negative Lévy process (without any further conditions) exceeds (upwards or downwards) or hits a certain level. As an application, we extend a result found in Doney (1991).

In this paper we study the tail behavior of the maximum exceedance of a sequence of independent and identically distributed random variables over a random walk. For both light-tailed and heavy-tailed cases, we derive a precise asymptotic formula, which extends and unifies some existing results in the recent literature of applied probability.

In this paper we consider the splitting method first introduced in rare event analysis. In this technique, the sample paths are split into R multiple copies at various stages to speed up the simulation. Given the cost, the optimization of the algorithm suggests taking all the transition probabilities to be equal; nevertheless, in practice, these quantities are unknown. We address this problem by presenting an algorithm in two phases.

In Lyons, Pemantle and Peres (1995), a martingale change of measure method was developed in order to give an alternative proof of the Kesten–Stigum L log L theorem for single-type branching processes. Later, this method was extended to prove the L log L theorem for multiple- and general multiple-type branching processes in Biggins and Kyprianou (2004), Kurtz et al. (1997), and Lyons (1997). In this paper we extend this method to a class of superdiffusions and establish a Kesten–Stigum L log L type theorem for superdiffusions. One of our main tools is a spine decomposition of superdiffusions, which is a modification of the one in Englander and Kyprianou (2004).

In extreme shock models, only the impact of the current, possibly fatal shock is usually taken into account, whereas in cumulative shock models, the impact of the preceding shocks is accumulated as well. In this paper we combine an extreme shock model with a specific cumulative shock model. It is shown that the proposed setting can also be interpreted as a generalization of the well-known Brown–Proschan model that describes repair actions for repairable systems. For a system subject to a specific process of shocks, we derive the survival probability and the corresponding failure rate function. Some meaningful interpretations and examples are discussed.

In this paper we study m-discount optimality (m ≥ −1) and Blackwell optimality for a general class of controlled (Markov) diffusion processes. To this end, a key step is to express the expected discounted reward function as a Laurent series, and then search certain control policies that lexicographically maximize the mth coefficient of this series for m = −1,0,1,…. This approach naturally leads to m-discount optimality and it gives Blackwell optimality in the limit as m → ∞.

In this paper, a distributional approximation to the time to extinction in a subcritical continuous-time Markov branching process is derived. A limit theorem for this distribution is established and the error in the approximation is quantified. The accuracy of the approximation is illustrated in an epidemiological example. Since Markov branching processes serve as approximations to nonlinear epidemic processes in the initial and final stages, our results can also be used to describe the time to extinction for such processes.

In this paper, we give an analytic solution for graphs with n nodes and E edges for which the probability of obtaining a given graph G is specified in terms of the degree sequence of G. We describe how this model naturally appears in the context of load balancing in communication networks, namely Peer-to-Peer overlays. We then analyse the degree distribution of such graphs and show that the degrees are concentrated around their mean value. Finally, we derive asymptotic results on the number of edges crossing a graph cut and use these results $(i)$ to compute the graph expansion and conductance, and $(ii)$ to analyse the graph resilience to random failures., Comment: 18 pages

In this paper we consider the class of Lévy processes that can be written as a Brownian motion time changed by an independent Lévy subordinator. Examples in this class include the variance-gamma (VG) model, the normal-inverse Gaussian model, and other processes popular in financial modeling. The question addressed is the precise relation between the standard first passage time and an alternative notion, which we call the first passage of the second kind, as suggested by Hurd (2007) and others. We are able to prove that the standard first passage time is the almost-sure limit of iterations of the first passage of the second kind. Many different problems arising in financial mathematics are posed as first passage problems, and motivated by this fact, we are led to consider the implications of the approximation scheme for fast numerical methods for computing first passage. We find that the generic form of the iteration can be competitive with other numerical techniques. In the particular case of the VG model, the scheme can be further refined to give very fast algorithms.

Let X1, X2, …, Xn be independent random variables uniformly distributed on [0,1]. We observe these sequentially and have to stop on exactly one of them. No recall of preceding observations is permitted. What stopping rule minimizes the expected rank of the selected observation? What is the value of the expected rank (as a function of n) and what is the limit of this value when n goes to ∞? This full-information expected selected-rank problem is known as Robbins' problem of minimizing the expected rank, and its general solution is unknown. In this paper we provide an alternative approach to Robbins' problem. Our model is similar to that of Gnedin (2007). For this, we consider a continuous-time version of the problem in which the observations follow a Poisson arrival process on ℝ+ × [0,1] of homogeneous rate 1. Translating the previous optimal selection problem in this setting, we prove that, under reasonable assumptions, the corresponding value function w(t) is bounded and Lipschitz continuous. Our main result is that the limiting value of the Poisson embedded problem exists and is equal to that of Robbins' problem. We prove that w(t) is differentiable and also derive a differential equation for this function. Although we have not succeeded in using this equation to improve on bounds on the optimal limiting value, we argue that it has this potential.

Let X 1, X 2, …, X n be independent random variables uniformly distributed on [0,1]. We observe these sequentially and have to stop on exactly one of them. No recall of preceding observations is permitted. What stopping rule minimizes the expected rank of the selected observation? What is the value of the expected rank (as a function of n) and what is the limit of this value when n goes to ∞? This full-information expected selected-rank problem is known as Robbins' problem of minimizing the expected rank, and its general solution is unknown. In this paper we provide an alternative approach to Robbins' problem. Our model is similar to that of Gnedin (2007). For this, we consider a continuous-time version of the problem in which the observations follow a Poisson arrival process on ℝ+ × [0,1] of homogeneous rate 1. Translating the previous optimal selection problem in this setting, we prove that, under reasonable assumptions, the corresponding value function w (t) is bounded and Lipschitz continuous. Our main result is that the limiting value of the Poisson embedded problem exists and is equal to that of Robbins' problem. We prove that w (t) is differentiable and also derive a differential equation for this function. Although we have not succeeded in using this equation to improve on bounds on the optimal limiting value, we argue that it has this potential.

In this paper we consider a class of quasi-birth-and-death processes for which explicit solutions can be obtained for the rate matrix R and the associated matrix G . The probabilistic interpretations of these matrices allow us to describe their elements in terms of paths on the two-dimensional lattice. Then determining explicit expressions for the matrices becomes equivalent to solving a lattice path counting problem, the solution of which is derived using path decomposition, Bernoulli excursions, and hypergeometric functions. A few applications are provided, including classical models for which we obtain some new results.

In the subfair red-and-black gambling problem, a gambler can stake any amount in his possession, winning an amount equal to the stake with probability w and losing the stake with probability 1 − w, where 0 < w < ½. The gambler seeks to maximize the probability of reaching a fixed fortune (to be normalized to unity) by gambling repeatedly with suitably chosen stakes. In their classic work, Dubins and Savage (1965), (1976) showed that it is optimal to play boldly. When there is a house limit of l (0 < l < ½), so that the gambler can stake no more than l, Wilkins (1972) showed that bold play remains optimal provided that 1 / l is an integer. On the other hand, building on an earlier surprising result of Heath, Pruitt and Sudderth (1972), Schweinsberg (2005) recently showed that, for all irrational 0 < l < ½ and all 0 < w < ½, bold play is not optimal for some initial fortune. The purpose of the present paper is to present several results supporting the conjecture that, for all rational l with 1 / l not an integer and all 0 < w < ½, bold play is not optimal for some initial fortune. While most of these results are based on Schweinsberg's method, in a special case where his method is shown to be inapplicable, we argue that the conjecture can be verified with the help of symbolic-computation software.

International audience; In this paper we present a stability criterion for processor-sharing queues, in which the throughput may depend on the number of customers in the system (such as in the case of interferences between users). Such a system is represented by a point measure-valued stochastic recursion keeping track of the remaining processing times of the customers.

In this paper we study the properties of total time on test transforms of order n and examine their applications in reliability analysis. It is shown that the successive transforms produce either distributions with increasing or bathtub-shaped failure rates or distributions with decreasing or upside bathtub-shaped failure rates. The ageing properties of the baseline distribution is compared with those of transformed distributions, and a partial order based on nth-order transforms and their implications are discussed.

What is a ‘cascading failure’? Whilst most people have an intuitive idea of what is meant by cascading, no definition exists within the framework of reliability theory. The aim of this paper is to explore the field of component dependence within a network structure, and to construct a definition of cascading failure.

In this paper we study the properties of total time on test transforms of order n and examine their applications in reliability analysis. It is shown that the successive transforms produce either distributions with increasing or bathtub-shaped failure rates or distributions with decreasing or upside bathtub-shaped failure rates. The ageing properties of the baseline distribution is compared with those of transformed distributions, and a partial order based on nth-order transforms and their implications are discussed.

In this paper we study the α-stable continuous-state branching processes (for α ∈ (1, 2]) and the α-stable continuous-state branching processes conditioned never to become extinct in the light of positive self-similarity. Understanding the interaction of the Lamperti transformation for continuous-state branching processes and the Lamperti transformation for positive, self-similar Markov processes gives access to a number of explicit results concerning the paths of α-stable continuous-state branching processes and α-stable continuous-state branching processes conditioned never to become extinct.

The representation of the reliability function of the lifetime of a coherent system as a mixture of the reliability function of order statistics associated with the lifetimes of its components is a very useful tool to study the ordering and the limiting behaviour of coherent systems. In this paper, we obtain several representations of the reliability functions of residual lifetimes of used coherent systems under two particular conditions on the status of the components or the system in terms of the reliability functions of residual lifetimes of order statistics.

In this paper, a new approach is proposed to investigate Blackwell-type renewal theorems for weighted renewal functions systematically according to which of the tails of weighted renewal constants or the underlying distribution is asymptotically heavier. Some classical results are improved considerably.

In this paper we study the α-stable continuous-state branching processes (for α ∈ (1, 2]) and the α-stable continuous-state branching processes conditioned never to become extinct in the light of positive self-similarity. Understanding the interaction of the Lamperti transformation for continuous-state branching processes and the Lamperti transformation for positive, self-similar Markov processes gives access to a number of explicit results concerning the paths of α-stable continuous-state branching processes and α-stable continuous-state branching processes conditioned never to become extinct.

The present paper generalises some results for spectrally negative Lévy processes to the setting of Markov additive processes (MAPs). A prominent role is assumed by the first passage times, which will be determined in terms of their Laplace transforms. These have the form of a phase-type distribution, with a rate matrix that can be regarded as an inverse function of the cumulant matrix. A numerically stable iteration to compute this matrix is given. The theory is first developed for MAPs without positive jumps and then extended to include positive jumps having phase-type distributions. Numerical and analytical examples show agreement with existing results in special cases.

In this paper, a branching process approximation for the spread of a Reed-Frost epidemic on a network with tunable clustering is derived. The approximation gives rise to expressions for the epidemic threshold and the probability of a large outbreak in the epidemic. It is investigated how these quantities varies with the clustering in the graph and it turns out for instance that, as the clustering increases, the epidemic threshold decreases. The network is modelled by a random intersection graph, in which individuals are independently members of a number of groups and two individuals are linked to each other if and only if they share at least one group., 17 pages, 1 figure

In this paper we consider a compound Poisson risk model where the insurer earns credit interest at a constant rate if the surplus is positive and pays out debit interest at another constant rate if the surplus is negative. Absolute ruin occurs at the moment when the surplus first drops below a critical value (a negative constant). We study the asymptotic properties of the absolute ruin probability of this model. First we investigate the asymptotic behavior of the absolute ruin probability when the claim size distribution is light tailed. Then we study the case where the common distribution of claim sizes are heavy tailed.

Nanosystems are devices that are in the size range of a billionth of a meter (1 x 10-9) and therefore are built necessarily from individual atoms. The one-dimensional nanosystems or linear nanosystems cover all the nanosized systems which possess one dimension that exceeds the other two dimensions, i.e. extension over one dimension is predominant over the other two dimensions. Here only two of the dimensions have to be on the nanoscale (less than 100 nanometers). In this paper we consider the structural relationship between a linear nanosystem and its atoms acting as components of the nanosystem. Using such information, we then assess the nanosystem's limiting reliability which is, of course, probabilistic in nature. We consider the linear nanosystem at a fixed moment of time, say the present moment, and we assume that the present state of the linear nanosystem depends only on the present states of its atoms.

The distributions of the run occurrences for a sequence of independent and identically distributed (i.i.d.) experiments are usually obtained by combinatorial methods (see Balakrishnan and Koutras (2002, Chapter 5)) and the resulting formulae are often very tedious, while the distributions for non i.i.d. experiments are generally intractable. It is therefore of practical interest to find a suitable approximate model with reasonable approximation accuracy. In this paper we demonstrate that the negative binomial distribution is the most suitable approximate model for the number of k-runs: it outperforms the Poisson approximation, the general compound Poisson approximation as observed in Eichelsbacher and Roos (1999), and the translated Poisson approximation in Rollin (2005). In particular, its accuracy of approximation in terms of the total variation distance improves when the number of experiments increases, in the same way as the normal approximation improves in the Berry-Esseen theorem.

In this paper we study the bias and the overtaking optimality criteria for continuous-time jump Markov decision processes in general state and action spaces. The corresponding transition rates are allowed to be unbounded, and the reward rates may have neither upper nor lower bounds. Under appropriate hypotheses, we prove the existence of solutions to the bias optimality equations, the existence of bias optimal policies, and an equivalence relation between bias and overtaking optimality.

In the classic Dubins-Savage subfair primitive casino gambling problem, the gambler can stake any amount in his possession, winning (1 − r)/r times the stake with probability w and losing the stake with probability 1 − w, 0 ≤ w ≤ r ≤ 1. The gambler seeks to maximize the probability of reaching a fixed fortune (the goal) by gambling repeatedly with suitably chosen stakes. This problem has recently been extended in a unifying framework to account for limited playing time as well as future discounting, under which bold play is known to be optimal provided that w ≤ ½ ≤ r. This paper is concerned with a further extension of the Dubins-Savage gambling problem involving time-dependent parameters, and shows that bold play not only maximizes the probability of reaching the goal, but also stochastically minimizes the number of plays needed to reach the goal. As a result, bold play also maximizes the expected utility, where the utility at the goal is only required to be monotone decreasing with respect to the number of plays needed to reach the goal. It is further noted that bold play remains optimal even when the time-dependent parameters are random.