Skip to main content

Multicollinearity

Multicollinearity arises in multiple regression when two or more explanatory variables are highly correlated, making their individual effects impossible to separate cleanly.

Also known ascollinearity

ByHoang TruongUpdated

FrameworkOrdinary least squares (OLS)

See it move

Loading infographic...

The infographic is a Venn diagram with two overlapping circles labelled Regressor X₁ and Regressor X₂. Each circle contains a region of unique variation, but the overlapping area — labelled "Shared variation: effect can't be separated" — represents the portion of each variable's movement that cannot be attributed to one regressor alone. A note below the diagram explains that a large shared region inflates standard errors and widens confidence intervals, while the point estimates of the coefficients remain unbiased.

Where it fits
SubjectData Analysis & StatisticsAdvancedTopicRegression Diagnostics & ProblemsAdvanced

The formula

LaTeX
VIFj=11Rj2\text{VIF}_j = \frac{1}{1 - R_j^2}

Variables

Variance inflation factor for regressor Xⱼ
R-squared from regressing Xⱼ on all other regressors in the model

A VIF above 10 (some thresholds use 5) flags damaging multicollinearity. A VIF of 1 means no correlation with the other regressors.