Logistic regression
Logistic regression models a binary outcome by expressing log-odds as a linear function of predictors, with fitted probabilities constrained to (0, 1) via the logistic function. Parameters are estimated by maximum likelihood.
What it is
See it move
Logistic regression models log(p ÷ (1 − p)) = β₀ + β₁X₁ + … + βₖXₖ, the log-odds of a binary outcome, rather than the probability directly, so the fitted p̂ always lies between 0 and 1. A bank might use income, loan-to-value ratio, and credit history to predict loan default, then apply a threshold, often 0.5, to classify each applicant. Exponentiating a coefficient gives the odds ratio for that predictor.
The formula
Variables
- probability of the event (outcome = 1) (dimensionless)
- odds of the event (dimensionless)
- intercept (dimensionless)
- coefficient for predictor Xⱼ; exp(βⱼ) gives the odds ratio (per unit of Xⱼ)
- j-th predictor variable (varies)
Log-odds (logit) form. Exponentiating any coefficient gives the multiplicative change in odds for a one-unit increase in that predictor.
Variables
- fitted probability of the event (dimensionless)
- intercept (dimensionless)
- coefficient for predictor Xⱼ (per unit of Xⱼ)
- j-th predictor variable (varies)
Sigmoid (logistic) function form; constrains fitted probabilities to (0, 1) by construction.
Check yourself
An analyst fits a logistic regression to predict whether a loan defaults (Y = 1) or not (Y = 0). The estimated coefficient on the borrower's credit score is β̂ = −0.04. Which of the following correctly interprets this coefficient?