Theory of Probability and Mathematical Statistics
Goodness of fit for generalized shrinkage estimation
C.-L. Cheng, Shalabh, A. Chaturvedi
Download PDF
Abstract: The present paper develops a goodness of fit statistic for the linear regression models fitted by the shrinkage type estimators. A family of double k-class estimators is considered as a shrinkage estimator which encompasses several estimators as its particular case. The covariance matrix of error term is assumed to be a non-identity matrix under two situations- known and unknown. The goodness of fit statistics based on the idea of coefficient of determination in multiple linear regression model is proposed for the family of double k-class estimators. Its first and second order moments up to the first order of approximation are derived and finite sample properties are studied using the Monte-Carlo simulation.
Keywords: Linear regression, non-spherical disturbances, coefficient of determination (R2), shrinkage estimation, generalized least squares estimator, feasible double k-class estimators, feasible generalized least squares estimator, double k-class estimators, goodness of fit.
Bibliography: 1. A. K. Srivastava, V. K. Srivastava, A. Ullah, The coefficient of determination and its adjusted version in linear regression models, Econometric Reviews, 14 (1995), 229–240.
2. A. T. K. Wan, A. Chaturvedi, Double k-class estimators in regression models with non-spherical disturbances, Journal of Multivariate Analysis, 79 (2001), no. 2, 226–250.
3. A. Ullah, S. Ullah, Double k-class estimators of coefficients in linear regression, Econometrica, 46 (1978), no. 3, 705–722.
4. A. Ullah, S. Ullah, Errata: Double k-class estimators of coefficients in linear regression, Econometrica, 49 (1978), no. 2, 554.
5. A. Ullah, V. K. Srivastava, Moments of the ratio of quadratic forms in non-normal variables with econometric examples, Journal of Econometrics, 52 (1994), 129–142.
6. A. Chaturvedi, Shalabh, Risk and Pitman closeness properties of feasible generalized double k-class estimators in linear regression models with non-spherical disturbances under balanced loss function, Journal of Multivariate Analysis, 90 (2004), no. 2, 229–256.
7. C.-L. Cheng, Shalabh, G. Garg, Coefficient of determination for multiple measurement error models, Journal of Multivariate Analysis, 126 (2014), 137–152.
8. C.-L. Cheng, Shalabh, G. Garg, Goodness of Fit in Restricted Measurement Error Models, Journal of Multivariate Analysis, 145 (2016), 101–116.
9. J. S. Crämer, Mean and variance of R 2 in small and moderate samples, Journal of Econometrics, 35 (1987), 253–266.
10. K. Ohtani, Minimum mean squared error estimation of each individual coefficients in a linear regression model, Journal of Statistical Planning and Inference, 62 (1997), 301–316.
11. K. Ohtani, Exact small sample properties of an operational variant of the minimum mean squared error estimator, Communications in Statistics (Theory and Methods), 25 (1996), 1223–1231.
12. K. Ohtani, D. E. A. Giles, The absolute error risks of regression “goodness of fit” measures, Journal of Quantitative Economics, 12 (1996), 17–26.
13. K. Ohtani, H. Hasegawa, On small scale properties of R 2 in a linear regression model with multivariate t errors and proxy variables, Econometric Theory, 9 (1993), 504–515.
14. M. D. Smith, Comparing approximations to the expectation of quadratic forms in normal variables, Econometric Reviews, 15 (1996), 81–95.
15. R. A. L. Carter, V. K. Srivastava, A. Chaturvedi, Selecting a double k-class estimator for regression coefficients, Statistics & Probability Letters, 18 (1993), no. 5, 363–371
16. R. W. Farebrother, The minimum mean square error linear estimator and ridge regression, Technometrics, 17 (1975), 127–128.
17. Shalabh, G. Garg, C. Heumann, Performance of double k-class estimators for coefficients in linear regression models with non-spherical disturbances under asymmetric losses, Journal of Multivariate Analysis, 112 (2012), 35–47.
18. T. J. Rothenberg, Hypothesis Testing in Linear Models when the Error Covariance Matrix is Nonscalar, Econometrica, 52 (1984), no. 4, 827–842.
19. T. W. Anderson, An Introduction to Multivariate Analysis, John Wiley, New Jersey. 2003.
