Beta
26715

Stochastic and Deterministic Study of Ridge Regression

Article

Last updated: 04 Jan 2025

Subjects

-

Tags

-

Abstract

The present paper is concerned with studying the ridge parameters  through deterministic and stochastic approach in the case of ordinary ridge regression (ORR). In the deterministic approach, some new formulas for the ridge parameters are proposed and compared with the formula suggested by Hoerl and Kennard (1970a). The performance of the proposed ridge parameters is evaluated through a simulation study in the presence of multicollinearity. An application using real data is given. The evaluation is based on the mean square error (MSE) and relative MSE (RMSE). In the stochastic approach, the main properties of the proposed new formulas and the formula suggested by Hoerl and Kennard (1970a) are studied. The probability density function (pdf) and distribution function of the formulas are derived. The empirical distributions of these formulas are derived using Pearson's method. It is found that the performance of the new formulas are better than ordinary least squares (OLS) and the formula suggested by Hoerl and Kennard (1970 a) for all selected distributions.  

DOI

10.21608/jsfc.2017.26715

Keywords

Ridge Regression, Deterministic approach, Stochastic approach, Monte Carlo simulation, Mean square error, Relative mean square error, Sampling distribution

Authors

First Name

Noha

Last Name

Abd_AlRahman

MiddleName

-

Affiliation

Noha E. Abd Al-Rahman1, Salwa A. Mousa2 and Amina E. Abo-Hussien3 1 Department of Statistics, Faculty of Commerce, Al-Azhar University, Girls' Branch, Dakahlia , Egypt.

Email

-

City

-

Orcid

-

Volume

17

Article Issue

1

Related Issue

4781

Issue Date

2017-01-01

Receive Date

2016-09-01

Publish Date

2017-01-01

Page Start

1

Page End

55

Print ISSN

1687-322X

Link

https://jsfc.journals.ekb.eg/article_26715.html

Detail API

https://jsfc.journals.ekb.eg/service?article_code=26715

Order

13

Type

المقالة الأصلية

Type Code

761

Publication Type

Journal

Publication Title

المجلة العلمية لقطاع کليات التجارة

Publication Link

https://jsfc.journals.ekb.eg/

MainTitle

Stochastic and Deterministic Study of Ridge Regression

Details

Type

Article

Created At

22 Jan 2023