1. On State Occupancies, First Passage Times and Duration in Non-Homogeneous Semi-Markov Chains
- Author
-
Evanthia Farmakioti, Haris Palikrousis, Alexandra K. Papadopoulou, Andreas C. Georgiou, and Pavlos Kolias
- Subjects
0303 health sciences ,Markov chain ,Human dna ,General Mathematics ,duration ,DNA sequences ,State (functional analysis) ,semi-Markov modeling ,01 natural sciences ,non-homogeneity ,010104 statistics & probability ,03 medical and health sciences ,Duration (music) ,Non homogeneous ,QA1-939 ,first passage time ,Computer Science (miscellaneous) ,Statistical physics ,0101 mathematics ,First-hitting-time model ,Engineering (miscellaneous) ,Mathematics ,occupancy ,030304 developmental biology - Abstract
Semi-Markov processes generalize the Markov chains framework by utilizing abstract sojourn time distributions. They are widely known for offering enhanced accuracy in modeling stochastic phenomena. The aim of this paper is to provide closed analytic forms for three types of probabilities which describe attributes of considerable research interest in semi-Markov modeling: (a) the number of transitions to a state through time (Occupancy), (b) the number of transitions or the amount of time required to observe the first passage to a state (First passage time) and (c) the number of transitions or the amount of time required after a state is entered before the first real transition is made to another state (Duration). The non-homogeneous in time recursive relations of the above probabilities are developed and a description of the corresponding geometric transforms is produced. By applying appropriate properties, the closed analytic forms of the above probabilities are provided. Finally, data from human DNA sequences are used to illustrate the theoretical results of the paper.
- Published
- 2021