Quantcast
Get Help And Discuss STEM Concepts From Math To Data Science & Financial Literacy

Help The Education Support Forum through MathsGee serve learners across Africa with a DONATION

0 like 0 dislike
7 views
After analyzing the model, your manager has informed that your regression model is suffering from multicollinearity. How would you check if he’s true? Without losing any information, can you still build a better model?
in Data Science by Diamond (47.9k points) | 7 views

1 Answer

0 like 0 dislike
To check multicollinearity, we can create a correlation matrix to identify & remove variables having correlation above 75% (deciding a threshold is subjective). In addition, we can use calculate VIF (variance inflation factor) to check the presence of multicollinearity. VIF value <= 4 suggests no multicollinearity whereas a value of >= 10 implies serious multicollinearity. Also, we can use tolerance as an indicator of multicollinearity.

But, removing correlated variables might lead to loss of information. In order to retain those variables, we can use penalized regression models like ridge or lasso regression. Also, we can add some random noise in correlated variable so that the variables become different from each other. But, adding noise might affect the prediction accuracy, hence this approach should be carefully used.
by Wooden (3.0k points)

Related questions

1 like 0 dislike
1 answer
asked Sep 23 in Grade 8 EMS by CT Silver Status (28.6k points) | 4 views
0 like 0 dislike
1 answer
0 like 0 dislike
1 answer
0 like 0 dislike
1 answer
asked Apr 23 in Dept of Transport FAQs by Tedsf Diamond (47.9k points) | 20 views

Welcome to MathsGee Q&A Bank, Africa’s largest personalized STEM and Financial Literacy education network that helps people find answers to problems, connect with others and take action to improve their outcomes.


MathsGee Q&A is the STEM and Financial Literacy knowledge-sharing community where students and experts put their heads together to crack their toughest questions.


Help The Education Support Forum through MathsGee serve learners across Africa with a DONATION

Enter your email address: