Search

This paper concentrates on the minimal hitting probability of continuous-time controlled Markov systems (CTCMSs) with countable state and finite admissible action spaces. The existence of an optimal policy is first proved. In particular, for a special and important case of controlled branching processes (CBPs), it is proved that the minimal hitting probability is the unique solution to an improved optimal system of equations. Furthermore, a novel and precise improved-policy iteration algorithm of an optimal policy and the minimal hitting probability (minimal extinction probability) is presented for CBPs.

The main purpose of this paper is to consider the multiple birth properties for multi-type Markov branching processes. We first construct a new multi-dimensional Markov process based on the multi-type Markov branching process, which can reveal the multiple birth characteristics. Then the joint probability distribution of multiple birth of multi-type Markov branching process until any time $t$ is obtained by using the new process. Furthermore, the probability distribution of multiple birth until the extinction of the process is also given.

This paper concentrates on the limit behavior of discrete-time branching process with circular mechanism. Three types of limit behaviour of discrete-time branching process with circular mechanism are given explicitly under various moment conditions on branching rates. It is shown that the rate of the first one is geometric, while the other two are supergeometric.

In this paper, we mainly consider the decay property of stopped $M^X/M/1$-queueing networks with $d (\geq 2)$ nodes. The exact value of the decay parameter $\lambda_{\mathcal{C}}$ is obtained by using a new method. Then, the corresponding $\lambda_{\mathcal{C}}$-invariant measures and quasi-distributions are presented., Comment: 20 pages

This paper concentrates on the general birth-death processes with two different types of catastrophes. The Laplace transform of transition probability function for birth-death processes with two-type catastrophes are is successfully expressed with the Laplace transform of transition probability function of the birth-death processes without catastrophe. The first effective catastrophe occurrence time is considered. The Laplace transform of its probability density function, expectation and variance are obtained., Comment: 18 pages

It is well-known that 0 is the absorbing state for a branching system. Each particle in the system lives a random long time and gives a random number of new particles at its death time. It stops when the system has no particle. This paper is devoted to studying the fixed range crossing numbers until any time t. The joint probability distribution of fixed range crossing numbers of such processes until time t is obtained by using a new method. In particular, the probability distribution of total death number is given for Markov branching processes until time t., Comment: 19 pages. arXiv admin note: text overlap with arXiv:2001.02353

We consider the down/up crossing property of weighted Markov branching processes. The joint probability distribution of multi crossing numbers of such processes are obtained. In particular, for Markov branching processes, the probability distribution of death number is given and for bulk-arrival queueing model, the joint probability distributions of service number and arrival number is also given., Comment: 14 pages

IIn this paper, we consider an M^X/M/c queue with state-dependent control at idle time and catastrophes. Properties of the queues which terminate when the servers become idle are firstly studied. Recurrence, equilibrium distribution and equilibrium queue-size structure are studied for the case of resurrection and no catastrophes. All of these results and the first effective catastrophe occurrence time are then investigated for the case of resurrection and catastrophes. In particular, we can obtain the Laplace transform of the transition probability for the absorptive M^X/M/c queue., Comment: 19pages

In this paper, we consider $n$-type Markov branching processes with immigration and resurrection. The uniqueness criteria are first established. Then, a new method is found and the explicit expression of extinction probability is successfully obtained in the absorption case, the mean extinction time is also given. The recurrence and ergodicity criteria are given if the state ${\bf 0}$ is not absorptive. Finally, if the resurrection rates are same as the immigration rates, the branching property and decay property are discussed in detail, it is shown that the process is a superimposition of a $n$-type branching process and an immigration. The exact value of the decay parameter $\lambda_Z$ is given for the irreducible class ${\bf Z}_+^n$. Moreover, the corresponding $\lambda_Z$-invariant measures/vectors and quasi-distributions are presented., Comment: 31pages