Crossref DOI: 10.31695/IJERAT
ISSN: 2454-6135

International Journal of Engineering Research and Advanced Technology (IJERAT)

Sign In  /  Sign Up

Article: Robust Regression Methods for Solving Non-Spherical Problem in Linear Regression

Article Category: Physics - applied

DOI: 10.31695/IJERAT.2019.3444

Pages: 28-36

Author: Nusirat Funmilayo Gatta,Waheed Babatunde Yahya,Mohammed Kabir Garba

Abstract: This study investigated the effects of non-spherical disturbance on the model parameters of some classical regression models. The aim was to examine the impacts of multicollinearity on the efficiency of classical Ordinary least squares (OLS) relative to the ridge regression (RR) and principal component regression (PCR) models. Data were simulated from a multivariate normal distribution with mean zero and variance-covariance matrix at various sample sizes 25, 50, 100, 200, 500 and 1000. To assess the asymptotic efficiency and consistency of these regression models in the presence of multicollinearity, the evaluation criteria used were the Variance, Absolute bias, Mean Square Error (MSE) and Mean Square Error of Prediction (MSEP). Results from this work showed that the RR model had smaller variance, absolute bias and MSE when it was compared with OLS. Also, the ridge estimator had the least MSEP when compared to both the OLS and PCR models. Hence, it can be concluded that the ridge estimator performed better than the OLS and PCR when explanatory variables are highly correlated.

Keyword: Ordinary least squares, Principal Component Regression, Ridge Regression, Spherical Disturbance, Mean Square Error.

Web Counter

Creative Commons Attribution 4.0 (International) Licence.(CC BY-NC 4.0)