{
  "id": "welch-anova",
  "title": "Welch’s ANOVA",
  "lang": "en",
  "source_lang": "en",
  "summary": "Welch’s ANOVA tests whether independent groups have equal population means without assuming equal population variances.",
  "category": "mathematics",
  "subcategory": "probability-statistics",
  "type": "concept",
  "aliases": [
    "Welch’s analysis of variance",
    "Welch’s unequal-variances ANOVA",
    "Welch’s one-way test"
  ],
  "generated_at": "2026-11-05",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/welch-anova/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/welch-anova/",
      "json": "https://aiwiki.page/zh/welch-anova.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "Welch’s ANOVA is a form of one-way analysis of variance that tests whether several independent groups have the same population mean while allowing their population variances to differ. It replaces the pooled-variance calculation of classical ANOVA with precision-weighted group means and an approximate reference distribution. The method is particularly useful when unequal variances occur together with unequal group sizes. It is named after Bernard Lewis Welch, who published the multi-group procedure in 1951."
    },
    {
      "heading": "Purpose and hypotheses",
      "text": "For \\(k\\) groups, let \\(\\mu_i\\) denote the population mean of group \\(i\\). Welch’s ANOVA tests the null hypothesis\n\n\\[H_0:\\mu_1=\\mu_2=\\cdots=\\mu_k\\]\n\nagainst the alternative that not all population means are equal.\n\nThis is an omnibus test: a statistically significant result provides evidence against equality of all the means, but does not identify which groups differ. Nor does it test whether the groups have identical distributions. In particular, unequal variances are permitted under the null hypothesis.\n\nClassical one-way ANOVA uses a pooled within-group variance to assess differences among sample means. Its usual reference distribution is exact under independent normal observations with a common population variance. When variances differ—a condition called heteroscedasticity—that reference distribution can be inaccurate, especially in unbalanced designs.\n\nWelch’s method instead estimates the uncertainty of each group mean separately. Its weighting and correction aim to keep the probability of a Type I error close to the chosen significance level without requiring equal variances."
    },
    {
      "heading": "Statistical formulation",
      "text": "Suppose group \\(i\\) contains observations \\(X_{ij}\\), for \\(j=1,\\ldots,n_i\\), where \\(n_i\\geq2\\). Define the sample mean and sample variance by\n\n\\[\\bar X_i=\\frac{1}{n_i}\\sum_{j=1}^{n_i}X_{ij}, \\qquad s_i^2=\\frac{1}{n_i-1} \\sum_{j=1}^{n_i}(X_{ij}-\\bar X_i)^2.\\]\n\nFor the usual formula, each sample variance must be positive. The estimated variance of \\(\\bar X_i\\) is \\(s_i^2/n_i\\), so its inverse-variance weight is\n\n\\[w_i=\\frac{n_i}{s_i^2}.\\]\n\nLet\n\n\\[W=\\sum_{i=1}^{k}w_i, \\qquad \\bar X_w=\\frac{\\sum_{i=1}^{k}w_i\\bar X_i}{W}.\\]\n\nThe weighted mean \\(\\bar X_w\\) gives greater influence to group means estimated more precisely. It serves as the reference point for the test; it is not generally the arithmetic mean of the group means or the mean of all pooled observations.\n\nDefine\n\n\\[A=\\sum_{i=1}^{k} \\frac{(1-w_i/W)^2}{n_i-1}.\\]\n\nWelch’s test statistic is\n\n\\[F_W= \\frac{ \\displaystyle \\frac{1}{k-1}\\sum_{i=1}^{k} w_i(\\bar X_i-\\bar X_w)^2 }{ \\displaystyle 1+\\frac{2(k-2)}{k^2-1}A }.\\]\n\nUnder the null hypothesis, it is compared approximately with an F distribution having degrees of freedom\n\n\\[\\nu_1=k-1, \\qquad \\nu_2=\\frac{k^2-1}{3A}.\\]\n\nThe denominator degrees of freedom usually are not integers and depend on both group sizes and estimated variances. They should not be replaced by the classical ANOVA value \\(N-k\\), where \\(N=\\sum_i n_i\\).\n\nThe upper-tail p-value is\n\n\\[p=\\Pr\\!\\left(F_{\\nu_1,\\nu_2}\\geq F_W\\right).\\]\n\nThe reference F distribution is an approximation, not an exact finite-sample distribution for arbitrary unequal population variances."
    },
    {
      "heading": "Why the weighting and correction matter",
      "text": "The standard error of a group mean is estimated by \\(s_i/\\sqrt{n_i}\\). Thus, a group with more observations or less within-group variation generally provides a more precise estimate of its population mean. Inverse-variance weighting incorporates these differences in precision.\n\nHowever, the weights themselves are estimated from the data. Simply comparing a weighted between-group sum of squares with an unadjusted reference distribution would not adequately account for their uncertainty. Welch’s correction modifies the statistic and its denominator degrees of freedom to improve the approximation.\n\nThis differs fundamentally from pooling all within-group variances into one common estimate. In classical ANOVA, unequal variances can distort the test in either direction:\n\n- When smaller groups have larger variances, the classical test can be liberal, rejecting the null too often.\n- When larger groups have larger variances, it can be conservative, rejecting too infrequently.\n\nThese are common patterns rather than universal rules; the degree of distortion depends on the group sizes and variance configuration."
    },
    {
      "heading": "Assumptions and limitations",
      "text": "Welch’s ANOVA relaxes the equal-variance assumption, not every assumption of one-way ANOVA.\n\nIndependent observations\n\nThe standard procedure assumes independence within and between groups. Repeated observations on the same participants, matched samples, and clustered observations require methods that account for their dependence. Unequal-variance correction does not repair an inappropriate experimental design.\n\nDistributional conditions\n\nThe standard derivation assumes a normal distribution within each population. With sufficiently large group sizes and finite variances, the central limit theorem can support approximate inference for group means when the original observations are not normal.\n\nNevertheless, performance can deteriorate with very small samples, severe skewness, heavy tails, or influential outliers. Large total sample size alone does not guarantee a good approximation if some groups remain very small.\n\nEstimable group variances\n\nThe procedure requires separate variance estimates for every group. A singleton group cannot supply one, while a group with zero sample variance makes the ordinary inverse-variance formula undefined. Very imprecise variance estimates in small groups can also impair the approximation.\n\nScope of the conclusion\n\nWelch’s ANOVA tests means on the outcome’s original measurement scale. It does not test equality of medians, establish that observed differences are practically important, or demonstrate causation without a suitable study design.\n\nA nonsignificant result is not evidence that the means are equivalent. It may reflect limited statistical power, substantial variability, or small differences."
    },
    {
      "heading": "Relationship to other methods",
      "text": "Classical one-way ANOVA\n\nBoth procedures test the same equality-of-means hypothesis. Their assumptions and calculations differ: classical ANOVA pools within-group variances, whereas Welch’s ANOVA estimates each mean’s precision separately.\n\nWith normally distributed populations sharing a common variance, classical ANOVA has an exact F reference distribution. Welch’s test remains approximate, although its performance is often similar under such conditions. The procedures are not numerically identical in general, even when sample variances happen to be equal.\n\nWelch’s two-sample t-test\n\nFor exactly two groups, Welch’s ANOVA is equivalent to the two-sided Welch two-sample t-test. Specifically,\n\n\\[F_W=t_W^2,\\]\n\nwhere\n\n\\[t_W= \\frac{\\bar X_1-\\bar X_2} {\\sqrt{s_1^2/n_1+s_2^2/n_2}}.\\]\n\nThe denominator degrees of freedom become the usual Welch–Satterthwaite approximation,\n\n\\[\\nu= \\frac{(s_1^2/n_1+s_2^2/n_2)^2} { \\displaystyle \\frac{(s_1^2/n_1)^2}{n_1-1} + \\frac{(s_2^2/n_2)^2}{n_2-1} }.\\]\n\nThe upper-tail F-test p-value then equals the two-sided t-test p-value.\n\nRank-based and robust alternatives\n\nRank-based tests do not generally test the same hypothesis as Welch’s ANOVA. In particular, a rank-based procedure is not automatically a test of population means and may respond to differences in distributional shape or spread.\n\nMethods based on trimmed means, robust variance estimates, or appropriately constructed resampling procedures address different departures from the standard model. A transformation of the outcome also changes the scale on which means are compared."
    },
    {
      "heading": "Follow-up comparisons and reporting",
      "text": "After an omnibus test, pairwise comparisons or planned contrasts may be used to investigate specific differences. These analyses must address unequal variances and, where relevant, multiple testing.\n\nThe Games–Howell procedure is a common approach for all pairwise comparisons when group variances and sizes may differ. Another approach uses pairwise Welch t-tests with a multiplicity adjustment, such as the Bonferroni correction. The omnibus test by itself does not provide multiplicity-adjusted pairwise conclusions.\n\nA report typically includes:\n\n- Each group’s sample size, mean, and standard deviation.\n- The Welch F statistic and both degrees of freedom.\n- The p-value.\n- Relevant mean differences and confidence intervals.\n- The method used for any follow-up comparisons.\n\nAn effect size should be defined explicitly rather than inferred from statistical significance. Classical ANOVA effect-size formulas based on pooled sums of squares cannot automatically be obtained by substituting the Welch F statistic into formulas intended for an ordinary ANOVA table."
    },
    {
      "heading": "Historical development and implementation",
      "text": "Welch’s 1951 paper, On the Comparison of Several Mean Values: An Alternative Approach, extended unequal-variance inference to comparisons among several means. The procedure belongs to a wider family of approximate methods for inference when normally distributed populations have unknown, unequal variances.\n\nIn R, the standard oneway.test function performs Welch’s one-way test when var.equal = FALSE, its default. Software may label the output “Welch’s ANOVA,” “Welch’s F test,” or “one-way analysis of means.” Distinguishing it from the ordinary pooled-variance ANOVA is essential when interpreting the reported statistic and degrees of freedom."
    }
  ],
  "links": [
    "analysis-of-variance",
    "variance",
    "null-hypothesis",
    "type-i-and-type-ii-errors",
    "sample-mean",
    "test-statistic",
    "f-distribution",
    "degrees-of-freedom",
    "p-value",
    "standard-error",
    "statistical-independence",
    "experimental-design",
    "normal-distribution",
    "central-limit-theorem",
    "causal-inference",
    "statistical-power",
    "welchs-t-test",
    "multiple-testing",
    "bonferroni-correction",
    "confidence-interval",
    "effect-size"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}