Theory of Probability and Mathematical Statistics
Entropies of Cox–Ingersoll–Ross and Bessel processes as functions of time and of related parameters
Ivan Kucha, Yuliya Mishura and Kostiantyn Ralchenko
Link
Abstract: We investigate the long-time asymptotic behavior of various entropy measures associated with the Cox–Ingersoll–Ross (CIR) and squared Bessel processes. As the one-dimensional distributions of both processes follow noncentral chi-squared laws, we first derive sufficient conditions for the existence of these entropy measures for a noncentral chi-squared random variable. We then analyze their limiting behavior as the noncentrality parameter approaches zero and apply these results to the Cox–Ingersoll–Ross and squared Bessel processes. We prove that, as time tends to infinity, the entropies of the CIR process converge to those of its stationary distribution, while for the squared Bessel process, the Shannon, Rényi, and generalized Rényi entropies diverge, however, the Tsallis and Sharma–Mittal entropies may diverge or remain finite depending on the entropy parameters. Finally, we demonstrate that, as the CIR process converges to the squared Bessel process, the corresponding entropies also converge.
Keywords: Cox–Ingersoll–Ross process, squared Bessel process, noncentral chi-squared distribution, entropy of stochastic processes, Shannon entropy, R´enyi entropy, Tsallis entropy, Sharma– Mittal entropy
Bibliography: Mohamed Ben Alaya and Ahmed Kebaier, Asymptotic behavior of the maximum likelihood estimator for ergodic and nonergodic square-root diffusions, Stoch. Anal. Appl. 31 (2013), no. 4, 552–573. MR 3175784, DOI 10.1080/07362994.2013.798175
I. Bodnarchuk, Y. Mishura, and K. Ralchenko, Properties of the Shannon, Rényi and other entropies: Dependence in parameters, robustness in distributions and extremes, in Mathematical Structures I – Stochastic and Analytic Structures with Applications, Springer Proc. Math. Stat., vol. 532, Springer, Cham, 2026, pp. 1–37.
Volodymyr Braiman, Anatoliy Malyarenko, Yuliya Mishura, and Yevheniia Anastasiia Rudyk, Properties of Shannon and Rényi entropies of the Poisson distribution as the functions of intensity parameter, Nonlinear Anal. Model. Control 29 (2024), no. 4, 802–815. MR 4771134, DOI 10.15388/namc.2024.29.35560
Damiano Brigo and Fabio Mercurio, A deterministic-shift extension of analytically-tractable and time-homogeneous short-rate models, Finance Stoch. 5 (2001), no. 3, 369–387. MR 1849427, DOI 10.1007/PL00013541
Patrick Cattiaux, Giovanni Conforti, Ivan Gentil, and Christian Léonard, Time reversal of diffusion processes under a finite entropy condition, Ann. Inst. Henri Poincaré Probab. Stat. 59 (2023), no. 4, 1844–1881 (English, with English and French summaries). MR 4663509, DOI 10.1214/22-aihp1320
Pablo M. Cincotta and Claudia M. Giordano, Estimation of diffusion time with the Shannon entropy approach, Phys. Rev. E 107 (2023), no. 6, Paper No. 064101, 9. MR 4617872, DOI 10.1103/physreve.107.064101
John C. Cox, Jonathan E. Ingersoll Jr., and Stephen A. Ross, A theory of the term structure of interest rates, Econometrica 53 (1985), no. 2, 385–407. MR 785475, DOI 10.2307/1911242
Alessandro De Gregorio and Stefano M. Iacus, On Rényi information for ergodic diffusion processes, Inform. Sci. 179 (2009), no. 3, 279–291. MR 2473016, DOI 10.1016/j.ins.2008.09.016
Marco Di Francesco and Kevin Kamm, How to handle negative interest rates in a CIR framework, SeMA J. 79 (2022), no. 4, 593–618. MR 4503161, DOI 10.1007/s40324-021-00267-w
Dmitri Finkelshtein, Anatoliy Malyarenko, Yuliya Mishura, and Kostiantyn Ralchenko, Entropies of the Poisson distribution as functions of intensity: “normal” and “anomalous” behavior, Methodol. Comput. Appl. Probab. 27 (2025), no. 2, Paper No. 45, 32. MR 4908962, DOI 10.1007/s11009-025-10171-9
H. Föllmer, An entropy approach to the time reversal of diffusion processes, Stochastic differential systems (Marseille-Luminy, 1984) Lect. Notes Control Inf. Sci., vol. 69, Springer, Berlin, 1985, pp. 156–163. MR 798318, DOI 10.1007/BFb0005070
Anja Göing-Jaeschke and Marc Yor, A survey and some generalizations of Bessel processes, Bernoulli 9 (2003), no. 2, 313–349. MR 1997032, DOI 10.3150/bj/1068128980
J. Gómez-Gardenes and V. Latora, Entropy rate of diffusion processes on complex networks, Physical Review E 78 (2008), no. 6, 065102.
H. van Haeringen and L. P. Kok, Table errata: Table of integrals, series, and products [corrected and enlarged edition, Academic Press, New York, 1980; MR 81g:33001] by I. S. Gradshteyn [I. S. Gradshteĭn] and I. M. Ryzhik, Math. Comp. 39 (1982), no. 160, 747–757. MR 669666, DOI 10.1090/S0025-5718-1982-0669666-2
Norman L. Johnson, Samuel Kotz, and N. Balakrishnan, Continuous univariate distributions. Vol. 1, 2nd ed., Wiley Series in Probability and Mathematical Statistics: Applied Probability and Statistics, John Wiley & Sons, Inc., New York, 1994. A Wiley-Interscience Publication. MR 1299979
Norman L. Johnson, Samuel Kotz, and N. Balakrishnan, Continuous univariate distributions. Vol. 2, 2nd ed., Wiley Series in Probability and Mathematical Statistics: Applied Probability and Statistics, John Wiley & Sons, Inc., New York, 1995. A Wiley-Interscience Publication. MR 1326603
Yudell L. Luke, Inequalities for generalized hypergeometric functions, J. Approximation Theory 5 (1972), 41–65. MR 350082, DOI 10.1016/0021-9045(72)90028-7
A. Malyarenko, Y. Mishura, K. Ralchenko, and Y. A. Rudyk, Properties of various entropies of Gaussian distribution and comparison of entropies of fractional processes, Axioms 12 (2023), no. 11, 1026.
Anatoliy Malyarenko, Yuliya Mishura, Kostiantyn Ralchenko, and Sergiy Shklyar, Entropy and alternative entropy functionals of fractional Gaussian noise as the functions of Hurst index, Fract. Calc. Appl. Anal. 26 (2023), no. 3, 1052–1081. MR 4599227, DOI 10.1007/s13540-023-00155-2
Yuliya Mishura, Andrey Pilipenko, and Anton Yurchenko-Tytarenko, Low-dimensional Cox-Ingersoll-Ross process, Stochastics 96 (2024), no. 5, 1530–1550. MR 4841881, DOI 10.1080/17442508.2023.2300291
Y. Mishura and K. Ralchenko, Entropies and fractionality: Entropy functionals, small deviations and related integral equations, Chapman & Hall/CRC Numerical Analysis and Scientific Computing Series, Chapman & Hall/CRC, 2025.
Y. Mishura, K. Ralchenko, and S. Kushnirenko, Driven by Brownian motion Cox–Ingersoll–Ross and squared Bessel processes: Interaction and phase transition, Physics of Fluids 37 (2025), no. 1, 017115.
Yuliya Mishura, Kostiantyn Ralchenko, Petro Zelenko, and Volodymyr Zubchenko, Properties of the entropic risk measure EVaR in relation to selected distributions, Mod. Stoch. Theory Appl. 11 (2024), no. 4, 373–394. MR 4795239, DOI 10.15559/24-vmsta255
Yuliya Mishura and Anton Yurchenko-Tytarenko, Standard and fractional reflected Ornstein-Uhlenbeck processes as the limits of square roots of Cox-Ingersoll-Ross processes, Stochastics 95 (2023), no. 1, 99–117. MR 4556094, DOI 10.1080/17442508.2022.2047188
S. Nadarajah and K. Zografos, Formulas for Rényi information and related measures for univariate distributions, Inform. Sci. 155 (2003), no. 1-2, 119–138. MR 2007035, DOI 10.1016/S0020-0255(03)00156-7
Tomohiro Nishiyama and Igal Sason, On relations between the relative entropy and -divergence, generalizations and applications, Entropy 22 (2020), no. 5, Paper No. 563, 36. MR 4218264, DOI 10.3390/e22050563
G. Orlando and M. Lampart, Expecting the unexpected: Entropy and multifractal systems in finance, Entropy 25 (2023), no. 11, 1527.
G. Orlando, R. M. Mininni, and M. Bufalo, Interest rates calibration with a CIR model, J. Risk Finance 20 (2019), no. 4, 370–387.
Jim Pitman and Marc Yor, Bessel processes and infinitely divisible laws, Stochastic integrals (Proc. Sympos., Univ. Durham, Durham, 1980) Lecture Notes in Math., vol. 851, Springer, Berlin, 1981, pp. 285–370. MR 620995
Daniel Revuz and Marc Yor, Continuous martingales and Brownian motion, 3rd ed., Grundlehren der mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], vol. 293, Springer-Verlag, Berlin, 1999. MR 1725357, DOI 10.1007/978-3-662-06400-9
Ruslan L. Stratonovich, Theory of information and its value, Springer, Cham, [2020] ©2020. Translation of the 1975 Russian original; Edited by Roman V. Belavkin, Panos M. Pardalos and Jose C. Principe. MR 4391395, DOI 10.1007/978-3-030-22833-0
G. N. Watson, A treatise on the theory of Bessel functions, Cambridge Mathematical Library, Cambridge University Press, Cambridge, 1995. Reprint of the second (1944) edition. MR 1349110
Zhiyi Zhang, A limiting Gaussian process in entropic perspective, Theory Probab. Math. Statist. 112 (2025), 195–202. MR 4912649, DOI 10.1090/tpms/1234