{
  "id": "pseudo-r-squared",
  "title": "Pseudo-R-squared",
  "lang": "en",
  "source_lang": "en",
  "summary": "Pseudo-R-squared denotes a family of model-fit measures analogous to ordinary R-squared, especially for models with categorical outcomes.",
  "category": "mathematics",
  "subcategory": "probability-statistics",
  "type": "concept",
  "aliases": [
    "Pseudo R-squared",
    "pseudo-\\(R^2\\)",
    "pseudo coefficient of determination"
  ],
  "generated_at": "2026-11-05",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/pseudo-r-squared/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/pseudo-r-squared/",
      "json": "https://aiwiki.page/zh/pseudo-r-squared.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "Pseudo-R-squared is a collective name for statistics designed to play a role similar to the coefficient of determination in statistical models where ordinary \\(R^2\\) does not have its usual interpretation. Such measures are especially common in logistic regression, other models for categorical outcomes, and some generalized linear models. They may quantify improvement in likelihood over a baseline model, reduction in prediction error, separation between outcome groups, or explained variation on an assumed latent scale. There is no single standard pseudo-\\(R^2\\), and different definitions can give substantially different values for the same fitted model."
    },
    {
      "heading": "Relationship to ordinary R-squared",
      "text": "In linear regression fitted by ordinary least squares with an intercept, ordinary \\(R^2\\) is\n\n\\[R^2 = 1-\\frac{\\sum_{i=1}^{n}(y_i-\\widehat y_i)^2} {\\sum_{i=1}^{n}(y_i-\\bar y)^2},\\]\n\nwhere \\(y_i\\) is an observed response, \\(\\widehat y_i\\) its fitted value, and \\(\\bar y\\) the sample mean. The least-squares decomposition gives this statistic its familiar interpretation as the proportion of observed response variation explained by the fitted model.\n\nThat interpretation does not automatically extend to other models. For a binary response, for example, fitted values are probabilities, the conditional variance changes with the mean, and estimation usually maximizes a likelihood rather than minimizing squared errors. Several properties that coincide in ordinary least-squares regression therefore lead to distinct measures when generalized:\n\n- improvement over an intercept-only model;\n- reduction in squared prediction error;\n- association between observed outcomes and predictions;\n- explained variance in an underlying continuous response.\n\nThe prefix pseudo indicates this analogy, not that the statistic is invalid. It also warns that a value such as \\(0.30\\) generally cannot be interpreted as “30% of the outcome variance explained.”"
    },
    {
      "heading": "Likelihood-based measures",
      "text": "Let \\(L_1\\) denote the maximized likelihood of the fitted model and \\(L_0\\) that of a baseline model, usually an intercept-only model fitted to the same observations. Write\n\n\\[\\ell_1=\\log L_1, \\qquad \\ell_0=\\log L_0.\\]\n\nThe baseline specifies what improvement is being measured. In binary logistic regression without weights or offsets, an intercept-only model assigns every observation the observed event proportion.\n\nMcFadden’s pseudo-R-squared\n\nMcFadden’s measure is\n\n\\[R^2_{\\mathrm{McF}} = 1-\\frac{\\ell_1}{\\ell_0}.\\]\n\nFor ordinary categorical probability likelihoods, log-likelihoods are nonpositive. When the fitted model includes the baseline and both are successfully fitted by maximum likelihood estimation, \\(\\ell_1\\geq\\ell_0\\), so this statistic is nonnegative. It is zero when the fitted model provides no likelihood improvement and approaches one as the fitted probabilities of the observed outcomes approach one.\n\nIts scale differs from ordinary \\(R^2\\). It measures proportional reduction in negative log-likelihood relative to the baseline, not proportional reduction in observed variance.\n\nAn adjusted version is commonly written\n\n\\[\\overline R^2_{\\mathrm{McF}} = 1-\\frac{\\ell_1-k}{\\ell_0},\\]\n\nwhere \\(k\\) is a parameter-count penalty. Conventions for counting parameters can differ, including whether the intercept is included. Unlike the unadjusted measure under the conditions above, the adjusted statistic can be negative and need not increase when predictors are added.\n\nCox–Snell pseudo-R-squared\n\nThe Cox–Snell measure is\n\n\\[R^2_{\\mathrm{CS}} = 1-\\left(\\frac{L_0}{L_1}\\right)^{2/n} = 1-\\exp\\left[\\frac{2}{n}(\\ell_0-\\ell_1)\\right].\\]\n\nIt is a transformation of the likelihood-ratio improvement. Defining\n\n\\[G^2=2(\\ell_1-\\ell_0),\\]\n\ngives\n\n\\[R^2_{\\mathrm{CS}}=1-\\exp(-G^2/n).\\]\n\nIts construction recovers ordinary \\(R^2\\) for a Gaussian linear model fitted by maximum likelihood with an intercept and an estimated error variance.\n\nFor individual binary observations, however, its upper bound is generally below one. A perfect fit has \\(L_1=1\\), giving\n\n\\[R^2_{\\mathrm{CS,max}} = 1-L_0^{2/n} = 1-\\exp(2\\ell_0/n).\\]\n\nThis bound depends on the baseline outcome distribution. Consequently, even perfect binary predictions cannot produce a Cox–Snell value of one.\n\nNagelkerke pseudo-R-squared\n\nNagelkerke’s measure, also called the Cragg–Uhler measure in many applications, rescales Cox–Snell’s measure:\n\n\\[R^2_{\\mathrm{N}} = \\frac{1-\\exp\\left[\\frac{2}{n}(\\ell_0-\\ell_1)\\right]} {1-\\exp(2\\ell_0/n)}.\\]\n\nFor standard individual-level binary likelihoods, this normalization makes the theoretical upper bound one. It does not establish an ordinary explained-variance interpretation, nor does it make the statistic directly interchangeable with other pseudo-\\(R^2\\) measures.\n\nRelationship to deviance\n\nFor a model with log-likelihood \\(\\ell\\), deviance is defined relative to a saturated model:\n\n\\[D=2(\\ell_{\\mathrm{sat}}-\\ell).\\]\n\nA deviance-based measure can therefore be written as\n\n\\[R^2_D=1-\\frac{D_1}{D_0},\\]\n\nwhere \\(D_1\\) and \\(D_0\\) are fitted-model and baseline deviances.\n\nFor individual Bernoulli observations, the saturated log-likelihood is zero under the usual likelihood convention, so this measure equals McFadden’s measure. That identity does not hold universally: grouped responses and other response distributions can have nonzero saturated log-likelihoods."
    },
    {
      "heading": "Measures based on fitted probabilities",
      "text": "For binary observations, write \\(y_i\\in\\{0,1\\}\\) and let \\(\\widehat p_i\\) be the fitted probability that \\(y_i=1\\).\n\nEfron’s pseudo-R-squared\n\nEfron’s measure uses squared probability prediction errors:\n\n\\[R^2_{\\mathrm E} = 1- \\frac{\\sum_i(y_i-\\widehat p_i)^2} {\\sum_i(y_i-\\bar y)^2}.\\]\n\nIt compares the fitted model’s squared prediction error with that of the constant prediction \\(\\bar y\\). Its numerator is proportional to the binary mean squared error, often called the Brier score in this setting.\n\nDespite its resemblance to ordinary \\(R^2\\), logistic maximum likelihood does not directly minimize this numerator. The measure can be negative when predictions have larger squared error than the baseline. Its use is not equivalent to squaring the correlation between observations and fitted probabilities in arbitrary nonlinear models.\n\nTjur’s coefficient of discrimination\n\nTjur’s measure is\n\n\\[R^2_{\\mathrm T} = \\frac{1}{n_1}\\sum_{i:y_i=1}\\widehat p_i - \\frac{1}{n_0}\\sum_{i:y_i=0}\\widehat p_i,\\]\n\nwhere \\(n_1\\) and \\(n_0\\) are the numbers of observations in the two outcome groups.\n\nIt is the difference between the mean predicted probability among observed events and the mean predicted probability among observed nonevents. A value of zero indicates no difference between those group means; perfect predictions give one.\n\nThis measure provides a direct description of separation on the probability scale. For arbitrary predictions, including predictions evaluated on new data, it can be negative. It is undefined if either outcome group is absent."
    },
    {
      "heading": "Latent-variable measures",
      "text": "Some binary and ordinal models can be represented using an unobserved continuous response:\n\n\\[Y_i^*=x_i^\\mathsf{T}\\beta+\\varepsilon_i,\\]\n\nwith observed categories determined by thresholds applied to \\(Y_i^*\\).\n\nMcKelvey–Zavoina’s pseudo-\\(R^2\\) uses the variance decomposition on this latent scale:\n\n\\[R^2_{\\mathrm{MZ}} = \\frac{\\operatorname{Var}(x_i^\\mathsf{T}\\widehat\\beta)} {\\operatorname{Var}(x_i^\\mathsf{T}\\widehat\\beta) +\\operatorname{Var}(\\varepsilon_i)}.\\]\n\nUnder the conventional logistic latent-variable representation, the residual variance is \\(\\pi^2/3\\). Under a standard probit representation, whose residual follows a standard normal distribution, it is one.\n\nThis statistic concerns variation in the assumed latent response, not variation in the observed binary or ordinal outcome. Its meaning therefore depends on the latent-variable model and its scale assumptions."
    },
    {
      "heading": "Numerical example",
      "text": "Suppose a binary model fitted to \\(n=200\\) observations has\n\n\\[\\ell_0=-100, \\qquad \\ell_1=-70.\\]\n\nThen\n\n\\[R^2_{\\mathrm{McF}}=1-\\frac{-70}{-100}=0.30,\\]\n\n\\[R^2_{\\mathrm{CS}} = 1-\\exp(-0.30) \\approx0.259,\\]\n\nand\n\n\\[R^2_{\\mathrm N} = \\frac{1-\\exp(-0.30)}{1-\\exp(-1)} \\approx0.410.\\]\n\nAll three describe the same fitted model. Their differing values arise from different definitions, not different underlying fits."
    },
    {
      "heading": "Interpretation and limitations",
      "text": "Comparability depends on the definition and data\n\nA reported pseudo-\\(R^2\\) is incomplete without its name or formula. Comparisons are most interpretable when models use the same observations, outcome coding, baseline, likelihood convention, and measure.\n\nDifferences in event prevalence, response aggregation, observation weights, or sampled populations can alter the statistic. Values from different datasets therefore need not represent comparable levels of predictive performance.\n\nLikelihood ratios are unchanged by a common multiplicative likelihood constant, whereas ratios of log-likelihoods generally are not. This distinction matters when comparing software implementations or likelihood conventions.\n\nIn-sample improvement is not predictive validation\n\nFor nested models estimated by unpenalized maximum likelihood, adding parameters cannot reduce the maximized likelihood. Unadjusted likelihood-based pseudo-\\(R^2\\) measures therefore tend to improve even when added predictors capture sampling noise.\n\nA high in-sample value does not establish performance on new observations. Evaluation using cross-validation or held-out data addresses a different question. Likelihood nesting arguments also need not apply directly to estimates obtained with regularization.\n\nModel fit has several dimensions\n\nPseudo-\\(R^2\\) is not a substitute for statistical hypothesis testing, an assessment of probability calibration, or an evaluation of classification performance at a chosen threshold. Likelihood improvement, probability accuracy, ranking ability, and threshold-based accuracy describe different aspects of a model.\n\nNor does a large pseudo-\\(R^2\\) establish causal validity. Predictive fit does not by itself resolve confounding, selection effects, or other identification problems.\n\nBoundary cases require care\n\nIf every binary response has the same value, several definitions become undefined because the baseline has no outcome variation or has zero log-loss. Complete separation in logistic regression can also prevent finite maximum-likelihood coefficient estimates, even while likelihood-based fit measures approach their ideal values.\n\nFor out-of-sample predictions or models not fitted by ordinary maximum likelihood, negative values can be meaningful: they can indicate performance worse than the chosen baseline rather than an arithmetic error."
    }
  ],
  "links": [
    "coefficient-of-determination",
    "logistic-regression",
    "generalized-linear-model",
    "linear-regression",
    "ordinary-least-squares",
    "sample-mean",
    "variance",
    "likelihood-function",
    "maximum-likelihood-estimation",
    "mean-squared-error",
    "correlation",
    "normal-distribution",
    "cross-validation",
    "regularization",
    "statistical-hypothesis-testing",
    "causal-inference"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}