Get Help And Discuss STEM Concepts From Math To Data Science & Financial Literacy
STEM Gender Equality | Join us on ZOOM | Spreading Mathematical Happiness

MathsGee is free of annoying ads. We want to keep it like this. You can help with your DONATION

0 like 0 dislike
765 views
What are the advantages and disadvantages of using regularization methods like Ridge Regression?
in Data Science by Bronze Status (8,600 points) | 765 views

1 Answer

0 like 0 dislike

Advantages

  • Avoids overfitting a model.
  • They does not require unbiased estimators.
  • They add just enough bias to make the estimates reasonably reliable approximations to true population values.
  • They still perform well in cases of a large multivariate data with the number of predictors (p) larger than the number of observations (n).
  • The ridge estimator is preferably good at improving the least-squares estimate when there is multicollinearity.

Disadvantages

  • They include all the predictors in the final model.
  • They are unable to perform feature selection.
  • They shrink the coefficients towards zero.
  • They trade the variance for bias.
by Silver Status (29,840 points)

Related questions

0 like 0 dislike
1 answer
asked Sep 4 in Data Science by Tedsf Diamond (50,545 points) | 7 views
0 like 0 dislike
0 answers
0 like 0 dislike
1 answer
0 like 0 dislike
1 answer
asked Mar 11, 2019 in Data Science by Edzai Zvobwo Bronze Status (8,600 points) | 35 views
0 like 0 dislike
1 answer
1 like 0 dislike
0 answers

Welcome to MathsGee Q&A Bank, Africa’s largest personalized STEM and Financial Literacy education network that helps people find answers to problems, connect with others and take action to improve their outcomes.


MathsGee Q&A is the STEM and Financial Literacy knowledge-sharing community where students and experts put their heads together to crack their toughest questions.


MathsGee is free of annoying ads. We want to keep it like this. You can help with your DONATION

Enter your email address:

11,560 questions
9,542 answers
100 comments
10,451 users