Pseudo-R-squared is a collective name for statistics designed to play a role similar to the coefficient of determination in statistical models where ordinary does not have its usual interpretation. Such measures are especially common in logistic regression, other models for categorical outcomes, and some generalized linear models. They may quantify improvement in likelihood over a baseline model, reduction in prediction error, separation between outcome groups, or explained variation on an assumed latent scale. There is no single standard pseudo-, and different definitions can give substantially different values for the same fitted model.
Relationship to ordinary R-squared
In linear regression fitted by ordinary least squares with an intercept, ordinary is
where is an observed response, its fitted value, and the sample mean. The least-squares decomposition gives this statistic its familiar interpretation as the proportion of observed response variation explained by the fitted model.
That interpretation does not automatically extend to other models. For a binary response, for example, fitted values are probabilities, the conditional variance changes with the mean, and estimation usually maximizes a likelihood rather than minimizing squared errors. Several properties that coincide in ordinary least-squares regression therefore lead to distinct measures when generalized:
- improvement over an intercept-only model;
- reduction in squared prediction error;
- association between observed outcomes and predictions;
- explained variance in an underlying continuous response.
The prefix pseudo indicates this analogy, not that the statistic is invalid. It also warns that a value such as generally cannot be interpreted as “30% of the outcome variance explained.”
Likelihood-based measures
Let denote the maximized likelihood of the fitted model and that of a baseline model, usually an intercept-only model fitted to the same observations. Write
The baseline specifies what improvement is being measured. In binary logistic regression without weights or offsets, an intercept-only model assigns every observation the observed event proportion.
McFadden’s pseudo-R-squared
McFadden’s measure is
For ordinary categorical probability likelihoods, log-likelihoods are nonpositive. When the fitted model includes the baseline and both are successfully fitted by maximum likelihood estimation, , so this statistic is nonnegative. It is zero when the fitted model provides no likelihood improvement and approaches one as the fitted probabilities of the observed outcomes approach one.
Its scale differs from ordinary . It measures proportional reduction in negative log-likelihood relative to the baseline, not proportional reduction in observed variance.
An adjusted version is commonly written
where is a parameter-count penalty. Conventions for counting parameters can differ, including whether the intercept is included. Unlike the unadjusted measure under the conditions above, the adjusted statistic can be negative and need not increase when predictors are added.
Cox–Snell pseudo-R-squared
The Cox–Snell measure is
It is a transformation of the likelihood-ratio improvement. Defining
gives
Its construction recovers ordinary for a Gaussian linear model fitted by maximum likelihood with an intercept and an estimated error variance.
For individual binary observations, however, its upper bound is generally below one. A perfect fit has , giving
This bound depends on the baseline outcome distribution. Consequently, even perfect binary predictions cannot produce a Cox–Snell value of one.
Nagelkerke pseudo-R-squared
Nagelkerke’s measure, also called the Cragg–Uhler measure in many applications, rescales Cox–Snell’s measure:
For standard individual-level binary likelihoods, this normalization makes the theoretical upper bound one. It does not establish an ordinary explained-variance interpretation, nor does it make the statistic directly interchangeable with other pseudo- measures.
Relationship to deviance
For a model with log-likelihood , deviance is defined relative to a saturated model:
A deviance-based measure can therefore be written as
where and are fitted-model and baseline deviances.
For individual Bernoulli observations, the saturated log-likelihood is zero under the usual likelihood convention, so this measure equals McFadden’s measure. That identity does not hold universally: grouped responses and other response distributions can have nonzero saturated log-likelihoods.
Measures based on fitted probabilities
For binary observations, write and let be the fitted probability that .
Efron’s pseudo-R-squared
Efron’s measure uses squared probability prediction errors:
It compares the fitted model’s squared prediction error with that of the constant prediction . Its numerator is proportional to the binary mean squared error, often called the Brier score in this setting.
Despite its resemblance to ordinary , logistic maximum likelihood does not directly minimize this numerator. The measure can be negative when predictions have larger squared error than the baseline. Its use is not equivalent to squaring the correlation between observations and fitted probabilities in arbitrary nonlinear models.
Tjur’s coefficient of discrimination
Tjur’s measure is
where and are the numbers of observations in the two outcome groups.
It is the difference between the mean predicted probability among observed events and the mean predicted probability among observed nonevents. A value of zero indicates no difference between those group means; perfect predictions give one.
This measure provides a direct description of separation on the probability scale. For arbitrary predictions, including predictions evaluated on new data, it can be negative. It is undefined if either outcome group is absent.
Latent-variable measures
Some binary and ordinal models can be represented using an unobserved continuous response:
with observed categories determined by thresholds applied to .
McKelvey–Zavoina’s pseudo- uses the variance decomposition on this latent scale:
Under the conventional logistic latent-variable representation, the residual variance is . Under a standard probit representation, whose residual follows a standard normal distribution, it is one.
This statistic concerns variation in the assumed latent response, not variation in the observed binary or ordinal outcome. Its meaning therefore depends on the latent-variable model and its scale assumptions.
Numerical example
Suppose a binary model fitted to observations has
Then
and
All three describe the same fitted model. Their differing values arise from different definitions, not different underlying fits.
Interpretation and limitations
Comparability depends on the definition and data
A reported pseudo- is incomplete without its name or formula. Comparisons are most interpretable when models use the same observations, outcome coding, baseline, likelihood convention, and measure.
Differences in event prevalence, response aggregation, observation weights, or sampled populations can alter the statistic. Values from different datasets therefore need not represent comparable levels of predictive performance.
Likelihood ratios are unchanged by a common multiplicative likelihood constant, whereas ratios of log-likelihoods generally are not. This distinction matters when comparing software implementations or likelihood conventions.
In-sample improvement is not predictive validation
For nested models estimated by unpenalized maximum likelihood, adding parameters cannot reduce the maximized likelihood. Unadjusted likelihood-based pseudo- measures therefore tend to improve even when added predictors capture sampling noise.
A high in-sample value does not establish performance on new observations. Evaluation using cross-validation or held-out data addresses a different question. Likelihood nesting arguments also need not apply directly to estimates obtained with regularization.
Model fit has several dimensions
Pseudo- is not a substitute for statistical hypothesis testing, an assessment of probability calibration, or an evaluation of classification performance at a chosen threshold. Likelihood improvement, probability accuracy, ranking ability, and threshold-based accuracy describe different aspects of a model.
Nor does a large pseudo- establish causal validity. Predictive fit does not by itself resolve confounding, selection effects, or other identification problems.
Boundary cases require care
If every binary response has the same value, several definitions become undefined because the baseline has no outcome variation or has zero log-loss. Complete separation in logistic regression can also prevent finite maximum-likelihood coefficient estimates, even while likelihood-based fit measures approach their ideal values.
For out-of-sample predictions or models not fitted by ordinary maximum likelihood, negative values can be meaningful: they can indicate performance worse than the chosen baseline rather than an arithmetic error.