Theory of Probability and Mathematical Statistics
Revisiting recurrence criteria of birth and death processes. Short proofs
Oleg K. Zakusylo
Link
Abstract: The paper contains several new transparent proofs of criteria appearing in classification of birth and death processes (BDPs). They are almost purely probabilistic and differ from the classical techniques of three-term recurrence relations, continued fractions and orthogonal polynomials. Let T∞ be the passage time from zero to ∞. The regularity criterion says that T∞<∞ if and only if 𝔼T∞<∞. It is heavily based on a result of Gong, Y., Mao, Y.-H. and Zhang, C. [J. Theoret. Probab. 25 (2012), no. 4, 950–980]. We obtain the latter expectation by using a two-term recurrence relation. We observe that the recurrence criterion is an immediate consequence of the well-known recurrence criterion for discrete-time BDPs and a result of Chung K. L. [Markov Chains with Stationary Transition Probabilities, Springer-Verlag, New York (1967)]. We obtain the classical criterion of positive recurrence using technique of the common probability space. While doing so, we construct a monotone sequence of BDPs with finite state spaces converging to BDPs with an infinite state space.
Keywords: Classification of birth and death processes, monotone convergence of birth and death processes
Bibliography: K.-L. Chung, Markov Chains with Stationary Transition Probabilities, Springer-Verlag, New York (1967).
F. W. Crawford, L. S. T. Ho, and M. A. Suchard, Computational methods for birth-death processes, Wiley Interdiscip. Rev. Comput. Stat. 10 (2018), no. 2, e1423, 22. MR 3771529
E. B. Dynkin and A. A. Yushkevich, Markov Processes: Theorems and Problems, Plenum Press, New York, 1969, Translated from the Russian by James S. Wood. MR 0242252
I.I. Ezhov and V.M. Shurenkov, Ergodic theorems connected with the Markov property of random processes, Theory of Probability & Its Applications 21 (1976), no. 3, 635–639. MR 0420844
Y. Gong, Y.-H. Mao, and C. Zhang, Hitting time distributions for denumerable birth and death processes, J. Theoret. Probab. 25 (2012), no. 4, 950–980. MR 2993011
S. Karlin and J. McGregor, The classification of birth and death processes, Trans. Amer. Math. Soc. 86 (1957), 366–400. MR 94854
S. Karlin and J. McGregor, The differential equations of birth-and-death processes, and the Stieltjes moment problem, Trans. Amer. Math. Soc. 85 (1957), 489–546. MR 91566
S. Karlin and J. McGregor, Coincidence properties of birth and death processes, Pacific J. Math. 9 (1959), 1109–1140. MR 114247