Robust Regression Methods for Solving Non-Spherical Problem in Linear Regression

Authors

  • Nusirat Funmilayo Gatta
  • Waheed Babatunde Yahya
  • Mohammed Kabir Garba Department of Statistics, University of Ilorin, Ilorin,Kwara State, Nigeria

DOI:

https://doi.org/10.31695/IJERAT.2019.3444

Keywords:

Ordinary least squares, Principal Component Regression, Ridge Regression, Spherical Disturbance, Mean Square Error.

Abstract

This study investigated the effects of non-spherical disturbance on the model parameters of some classical regression models. The aim was to examine the impacts of multicollinearity on the efficiency of classical Ordinary least squares (OLS) relative to the ridge regression (RR) and principal component regression (PCR) models. Data were simulated from a multivariate normal distribution with mean zero and variance-covariance matrix at various sample sizes 25, 50, 100, 200, 500 and 1000. To assess the asymptotic efficiency and consistency of these regression models in the presence of multicollinearity, the evaluation criteria used were the Variance, Absolute bias, Mean Square Error (MSE) and Mean Square Error of Prediction (MSEP). Results from this work showed that the RR model had smaller variance, absolute bias and MSE when it was compared with OLS. Also, the ridge estimator had the least MSEP when compared to both the OLS and PCR models. Hence, it can be concluded that the ridge estimator performed better than the OLS and PCR when explanatory variables are highly correlated.

Downloads

Published

2019-05-20

Issue

Section

Articles

How to Cite

Robust Regression Methods for Solving Non-Spherical Problem in Linear Regression. (2019). International Journal of Engineering Research and Advanced Technology (ijerat) (E-ISSN 2454-6135) DOI: 10.31695 IJERAT, 5(5), 28-36. https://doi.org/10.31695/IJERAT.2019.3444