Premium
Multi‐state Stochastic Processes: A Statistical Flowgraph Perspective
Author(s) -
Collins David H.,
Huzurbazar Aparna V.
Publication year - 2013
Publication title -
international statistical review
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.051
H-Index - 54
eISSN - 1751-5823
pISSN - 0306-7734
DOI - 10.1111/j.1751-5823.2012.00193.x
Subject(s) - computer science , state (computer science) , parametric statistics , markov process , markov chain , algorithm , reliability (semiconductor) , stochastic process , process (computing) , terminal (telecommunication) , mathematical optimization , mathematics , statistics , machine learning , telecommunications , power (physics) , physics , quantum mechanics , operating system
Summary Two‐state models (working/failed or alive/dead) are widely used in reliability and survival analysis. In contrast, multi‐state stochastic processes provide a richer framework for modeling and analyzing the progression of a process from an initial to a terminal state, allowing incorporation of more details of the process mechanism. We review multi‐state models, focusing on time‐homogeneous semi‐Markov processes (SMPs), and then describe the statistical flowgraph framework, which comprises analysis methods and algorithms for computing quantities of interest such as the distribution of first passage times to a terminal state. These algorithms algebraically combine integral transforms of the waiting time distributions in each state and invert them to get the required results. The estimated transforms may be based on parametric distributions or on empirical distributions of sample transition data, which may be censored. The methods are illustrated with several applications.