Logistic regression
Logistic regression models a binary outcome by expressing log-odds as a linear function of predictors, with fitted probabilities constrained to (0, 1) via the logistic function. Parameters are estimated by maximum likelihood.
See it move
Logistic regression models log(p ÷ (1 − p)) = β₀ + β₁X₁ + … + βₖXₖ, the log-odds of a binary outcome, rather than the probability directly, so the fitted p̂ always lies between 0 and 1. A bank might use income, loan-to-value ratio, and credit history to predict loan default, then apply a threshold, often 0.5, to classify each applicant. Exponentiating a coefficient gives the odds ratio for that predictor.
The formula
Variables
- probability of the event (outcome = 1) (dimensionless)
- odds of the event (dimensionless)
- intercept (dimensionless)
- coefficient for predictor Xⱼ; exp(βⱼ) gives the odds ratio (per unit of Xⱼ)
- j-th predictor variable (varies)
Log-odds (logit) form. Exponentiating any coefficient gives the multiplicative change in odds for a one-unit increase in that predictor.
Variables
- fitted probability of the event (dimensionless)
- intercept (dimensionless)
- coefficient for predictor Xⱼ (per unit of Xⱼ)
- j-th predictor variable (varies)
Sigmoid (logistic) function form; constrains fitted probabilities to (0, 1) by construction.
Check yourself
An analyst fits a logistic regression to predict whether a loan defaults (Y = 1) or not (Y = 0). The estimated coefficient on the borrower's credit score is β̂ = −0.04. Which of the following correctly interprets this coefficient?