A Journal "Theory of Probability and Mathematical Statistics"
2024
2023
2022
2021
2020
2019
2018
2017
2016
2015
2014
2013
2012
2011
2010
2009
2008
2007
2006
2005
2004
2003
2002
2001
2000
1999
1998
1997
1996
1995
1994
1993
1992
1991
1990
1989
1988
1987
1986
1985
1984
1983
1982
1981
1980
1979
1978
1977
1976
1975
1974
1973
1972
1971
1970


Archive

About   Editorial Board   Contacts   Template   Publication Ethics   Peer Review Process   Special Issues   History  

Theory of Probability and Mathematical Statistics



Asymptotic properties of M-estimators of parameters of a nonlinear regression model with a random noise whose spectrum is singular

A. V. Ivanov, I. V. Orlovskyi

Download PDF

Abstract: Time continuous nonlinear regression model with a noise being a nonlinearly transformed Gaussian stationary process with a singular spectrum is considered in the paper. Sufficient conditions for the asymptotic normality of the M-estimator are found for the vector parameter in this model.

Keywords: Asymptotic uniqueness of an estimator, asymptotic normality, M-estimators, nonlinear regression models, singular spectrum

Bibliography:
1. P. J. Huber, Robust regression: asymptotics, conjectures and Monte-Carlo, Ann. Statist. 1 (1973), no. 5, 799-821.
2. P. J. Huber, Robust Statistics, John Wiley & Sons, Inc., New York, 1981.
3. F. R. Hampel, E. M. Ronchetti, P. J. Rousseeuw, and W. A. Stahel, Robust Statistics. The Approach Based on Influence Functions, Wiley, New York, 1986.
4. H. L. Koul, M-estimators in linear models with long range dependent errors, Stat. Probab. Lett. 14 (1992), 153-164.
5. H. L. Koul, Asymptotics of M-estimations in non-linear regression with long-range dependence errors, Proc. Athens Conf. Appl. Probabl. and Time Ser. Analysis (P. M. Robinson and M. Rosenblatt, eds.), Springer-Verlag Lecture Notes in Statistics, vol. II, 1996, pp. 272-291.
6. H. L. Koul and K. Mukherjee, Regression quantiles and related processes under long range dependent errors, J. Multiv. Anal. 51 (1994), 318-337.
7. L. Giraitis, H. L. Koul, and D. Surgailis, Asymptotic normality of regression estimators with long memory errors, Stat. Probab. Lett. 29 (1996), 317-335.
8. H. L. Koul and D. Surgailis, Asymptotic expansion of M-estimators with long memory errors, Ann. Statist. 25 (1997), 818-850.
9. H. L. Koul and D. Surgailis, Second order behavior of $ M$-estimators in linear regression with long-memory errors, J. Statist. Plann. Inference 91 (2000), 399-412.
10. H. L. Koul and D. Surgailis, Robust estimators in regression models with long memory errors, Theory and Application of Long-Range Dependence (P. Doukhan, G. Pantheism, and M. S. Taqqu, eds.), Birkhäuser, Boston, 2003, pp. 339-353.
11. L. Giraitis and H. L. Koul, Estimation of the dependence parameter in linear regression with long-range dependent errors, Stat. Probab. Lett. 29 (1996), 317-335.
12. R. T. Baillie, H. L. Koul, and D. Surgailis, Regression model fitting with a long memory covariance process, Economic Theory 20 (2004), 485-512.
13. A. V. Ivanov and N. N. Leonenko, Asymptotic behavior of $ M$-estimators in continuous-time non-linear regression with long-range dependent errors, Random Oper. Stoch. Equ. 10 (2002), no. 3, 201-222.
14. A. V. Ivanov and N. N. Leonenko, Robust estimators in nonlinear regression models with long-range dependence, Optimal Design and Related Areas in Optimization and Statistics (L. Pronzato and A. Zhigljavsky, eds.), Springer, Berlin, 2009, pp. 193-221.
15. A. V. Ivanov, Asymptotic properties of L_p-estimators, Theory Stoch. Process. 14(30) (2008), no. 1, 60-68.
16. A. V. Ivanov and I. V. Orlovsky, L_p-estimates in nonlinear regression with long-range dependence, Theory Stoch. Process. 7(23) (2002), no. 3-4, 38-49.
17. A. V. Ivanov and I. V. Orlovskyi, Consistency of M-estimators in nonlinear regression models with continuous time, Naukovi visti NTUU ''KPI'' 4(42) (2005), 140-147. (Ukrainian)
18. A. V. Ivanov and I. V. Orlovskyi, The uniqueness of M-estimators of parameters in nonlinear regression models, Naukovi Visti NTUU KPI'' 4(66) (2009), 135-141. (Ukrainian)
19. I. N. Savych, Consistency of quantile estimators in regression models with long-range dependent noise, Teor. Ĭmovir. Mat. Stat. translation in 82 (2010), 128-136; English transl. in Theory Probab. Math. Statist. 82 (2011), 129-138.
20. I. V. Orlovsky, M-estimates in nonlinear regression with weak dependence, Theory Stoch. Process. 9(25) (2003), no. 1-2, 108-122.
21. A. V. Ivanov and I. V. Orlovsky, Consistency of M-estimates in general nonlinear model, Theory Stoch. Process. 13(29) (2007), no. 1-2, 86-97.
22. I. V. Orlovsky, Asymptotic properties of M-estimators of parameters in nonlinear regression models, Abstract of candidate thesis (Physics and Mathematics), Kyiv National Taras Shevchenko University, Kyiv, 2007. (Ukrainian)
23. A. V. Ivanov, N. N. Leonenko, M. D. Ruiz-Medina, and I. N. Savych, Limit theorems for weighted non-linear transformations of Gaussian processes with singular spectra, Ann. Probab. 41 (2013), no. 2, 1088-1114.
24. Yu. V. Goncharenko and S. I. Lyashko, Brouwer's Theorem, ''KIĬ'', Kiev, 2000. (Russian)
25. V. V. Anh, V. P. Knopova, and N. N. Leonenko, Continuous-time stochastic processes with cyclical long-range dependence, Aust. NZ J. Stat. 46 (2004), 275-296.
26. A. V. Ivanov, N. N. Leonenko, M. D. Ruiz-Medina, B. M. Zhurakovsky, Estimation of harmonic component in regression with cyclically dependent errors, Statistics: A Journal of Theoretical and Applied Statistics, 49 (2015), no. 1, 156-186.
27. U. Grenander, On the estimation of regression coefficients in the case of an autocorrelated disturbance, Ann. Statist 25 (1954), no. 2, 252-272.
28. I. A. Ibragimov and Yu. A. Rozanov, Gaussian Random Processes, ''Nauka'', Moscow, 1970; English transl. Springer-Verlag, New York-Berlin, 1978.
29. P. Billingsley, Convergence of probability measures, John Wiley & Sons, Inc., New York-London-Sydney, 1968.
30. A. V. Ivanov and I. M. Savych, The $ \mu $-admissibility of a spectral density for long range dependent random noise in nonlinear regression models, Naukovi visti NTUU ''KPI'' 1 (2009), 143-148. (Ukrainian)
31. N. N. Leonenko and A. V. Ivanov, Statistical Analysis of Random Fields, ''Vyshcha Shkola'', Kiev, 1986; English transl., Kluwer Academic Publishers Group, Dordrecht, 1989.
32. R. N. Bhattacharya and R. Ranga Rao, Normal Approximation and Asymptotic Expansions, John Wiley & Sons, New York-London-Sydney, 1976.
33. J. H. Wilkinson, The Algebraic Eigen Value Problem, Clarendon Press, Oxford, 1962.