1. On Some Test Statistics for Testing the Regression Coefficients in Presence of Multicollinearity: A Simulation Study
- Author
-
B. M. Golam Kibria and Sergio Perez-Melo
- Subjects
multiple linear regression ,empirical power ,01 natural sciences ,Nominal size ,010104 statistics & probability ,0504 sociology ,Linear regression ,Statistics ,ridge regression ,0101 mathematics ,lcsh:Statistics ,lcsh:HA1-4737 ,Mathematics ,size of the test ,05 social sciences ,050401 social sciences methods ,Regression analysis ,General Medicine ,simulation study ,t-test ,Regression ,Nominal level ,Multicollinearity ,mean square error (mse) ,type i error rate ,Ordinary least squares ,Type I and type II errors - Abstract
Ridge regression is a popular method to solve the multicollinearity problem for both linear and non-linear regression models. This paper studied forty different ridge regression t-type tests of the individual coefficients of a linear regression model. A simulation study was conducted to evaluate the performance of the proposed tests with respect to their empirical sizes and powers under different settings. Our simulation results demonstrated that many of the proposed tests have type I error rates close to the 5% nominal level and, among those, all tests except one have considerable gain in powers over the standard ordinary least squares (OLS) t-type test. It was observed from our simulation results that seven tests based on some ridge estimators performed better than the rest in terms of achieving higher power gains while maintaining a 5% nominal size.
- Published
- 2020