Engineering and Applied Science Letter
Vol. 7 (2024), Issue 1, pp. 42 – 54
ISSN: 2617-9709 (Online) 2617-9695 (Print)
DOI: 10.30538/psrp-easl2024.0101

On the robustness of the Olanrewaju-Olanrewaju regression kernel-based to nonparametric kernels for Support Vector Regressor (SVR)

Rasaki Olawale Olanrewaju\(^{1,*}\), Toyin Omoyeni Oguntola\(^{2}\), Lukman Abiodun Nafiu\(^{3}\) and Sodiq Adejare Olanrewaju\(^{4}\)
\(^{1}\) Business Analytics Value Networks (BAVNs), Africa Business School (ABS), Mohammed VI Polytechnic University (UM6P), X4JH+QJR Avenue Mohamed Ben Abdellah Regragui, Rabat 10112, Morocco
\(^{2}\) Ladoke Akintola University of Technology, Ogbomoso, Oyo State, Nigeria
\(^{3}\) School of Graduates and Research at Metropolitan International University (MIU), Kampala, Uganda
\(^{4}\) Department of Statistics, University of Ibadan, Ibadan, University of Ibadan, 900001, Oyo State, Nigeria

Abstract

Rasaki Olawale Olanrewaju, Toyin Omoyeni Oguntola, Lukman Abiodun Nafiu and Sodiq Adejare Olanrewaju

Abstract:{In this article we studied and juxtaposed nonparametric Least Square and the Olanrewaju-Olanrewaju regression-type \({L_{(O – O){\lambda _{\gamma (\left| \theta \right|)}}}}\) kernels for supervised Support Vector Regressor (SVR) machine learning of hyperplane regression in a bivariate setting. The nonparametric kernels used to expound the SVR were Bisquare, Gaussian, Triweight, Uniform, Epanechnikov, and Triangular. Lagrangian multiplier estimation technique was adopted in estimating the involved SVR hyperplane regression coefficients as well as other embedded coefficients in each of the stated kernels. In addition, point estimate of the Euclidean distance (\(r\)) and error margin (\(d\)) in each of the SVR kernels were carved-out. In demonstration to the annual birthrate and its percentage change (\(\Delta \% \)) of the Nigeria populace from 1950 to 2023, the Olanrewaju-Olanrewaju regression-type kernel for SVR robustly outperformed the nonparametric and Least Square kernel-based SVRs with a miniature Cross-Validation index of -1205.49. 5.9% and 3.2% hyperplane estimated regression coefficients from the Olanrewaju-Olanrewaju kernel-based SVR were recorded for the annual birthrate and its percentage change (\(\Delta \% \)) respectively. Interpretably, this connotes that for every one percent increment in the annual birthrate per 1000, the mean rate of the Nigeria populace from 1950 to 2023 increased by 5.9% while other variables were held constant. Similarly, its percentage change per 1000 increased by 3.2% while other variables were held constant. In recommendation, the nonparametric and Olanrewaju-Olanrewaju regression-type SVRs as well as the Least Square SVR were pinpointed for future consideration of categorical, missing and zero bivariate observations.

Keywords:

Kernels, Lagrangian Multiplier, Least Square, Olanrewaju-Olanrewaju Regression-Type, Nonparametric Regression, Support Vector Regressor (SVR)