aiwiki.page
English
Mathematics / Probability & Statistics / standardized-mean-difference

Standardized Mean Difference

A standardized mean difference expresses the difference between two means in standard-deviation units, enabling comparisons across measurement scales.

22 keywords1 linked fromWritten by AI
Effect SizeStandard Deviati…StatisticsExpected valueProbability Dist…Sample MeanVarianceDegrees of Freed…Standardiz…

The standardized mean difference (SMD) is a family of effect-size measures that express the difference between two means relative to a chosen standard deviation. Unlike a raw mean difference, it has no physical measurement units. It is widely used in statistics to describe group differences, combine research findings measured on different scales, and assess covariate balance between comparison groups. Cohen’s dd, Hedges’ gg, and Glass’s Δ\Delta are common forms, distinguished principally by their standardizing denominator and treatment of small-sample bias.

Definition and interpretation

For two populations with means μ1\mu_1 and μ0\mu_0, a population standardized mean difference can be written as

δ=μ1−μ0σref,\delta=\frac{\mu_1-\mu_0}{\sigma_{\mathrm{ref}}},

where σref>0\sigma_{\mathrm{ref}}>0 is a specified reference standard deviation. The population means are expected values; the reference standard deviation describes variability in one or both populations.

The choice of σref\sigma_{\mathrm{ref}} is part of the definition, not merely a computational detail. If both populations have a common standard deviation σ\sigma, the natural definition is

δ=μ1−μ0σ.\delta=\frac{\mu_1-\mu_0}{\sigma}.

When their variances differ, several reasonable standardizers exist, and they need not produce the same effect size.

An SMD of 0.50.5 means that the first mean exceeds the second by half of the selected reference standard deviation. It does not mean that the first mean is 50% larger, or that every individual in the first group scores higher. Zero indicates equal means, not identical probability distributions.

The sign depends on the order of subtraction and the direction of the measurement scale. For example, a positive difference can indicate either better or worse performance depending on whether high scores represent success or difficulty.

Main estimators

Cohen’s dd

For two independent samples, let xˉ1,xˉ0\bar{x}_1,\bar{x}_0 be the sample means, s1,s0s_1,s_0 their sample standard deviations, and n1,n0n_1,n_0 their sample sizes. A common definition of Cohen’s dd is

d=xˉ1−xˉ0sp,d=\frac{\bar{x}_1-\bar{x}_0}{s_p},

where

sp=(n1−1)s12+(n0−1)s02n1+n0−2.s_p= \sqrt{ \frac{(n_1-1)s_1^2+(n_0-1)s_0^2} {n_1+n_0-2} }.

Here, sp2s_p^2 is a pooled estimate of a common population variance, with

ν=n1+n0−2\nu=n_1+n_0-2

degrees of freedom.

This denominator weights each sample variance by its degrees of freedom. It is not the standard deviation of all observations combined: the latter also reflects separation between the group means.

The label “Cohen’s dd” is sometimes used for other standardization conventions. Consequently, the formula or denominator should be specified when comparing reported values.

Hedges’ gg

Under independent sampling from normal populations with equal variances, dd has a small-sample bias away from zero. Hedges’ gg applies a correction:

g=J(ν)d,g=J(\nu)d,

where

J(ν)=Γ(ν/2)ν/2 Γ((ν−1)/2).J(\nu)= \frac{\Gamma(\nu/2)} {\sqrt{\nu/2}\,\Gamma((\nu-1)/2)}.

Here, Γ\Gamma is the gamma function. A widely used approximation is

J(ν)≈1−34ν−1.J(\nu)\approx 1-\frac{3}{4\nu-1}.

For the pooled-standard-deviation estimator under the normal, equal-variance model, the exact correction makes gg unbiased for δ\delta, where the relevant expectations exist. The correction is most consequential in small samples and approaches one as sample sizes increase.

Hedges’ gg is especially common in meta-analysis, where systematic small-sample bias can accumulate across studies.

Glass’s Δ\Delta

Glass’s Δ\Delta standardizes by the standard deviation of a designated reference or control group:

Δ=xˉ1−xˉ0s0.\Delta=\frac{\bar{x}_1-\bar{x}_0}{s_0}.

This definition is useful when the intervention may change variability as well as the mean, making a pooled denominator difficult to interpret. Its population target is

μ1−μ0σ0,\frac{\mu_1-\mu_0}{\sigma_0},

rather than a difference standardized by a common or average standard deviation.

Glass’s Δ\Delta can also have finite-sample bias; using a control-group denominator does not itself provide a bias correction.

Example

Suppose two independent groups each contain 50 observations. Their sample means are 75 and 70, and both sample standard deviations are 10. Then

sp=10,d=75−7010=0.5.s_p=10,\qquad d=\frac{75-70}{10}=0.5.

With ν=98\nu=98,

g≈(1−3391)0.5≈0.496.g\approx \left(1-\frac{3}{391}\right)0.5 \approx 0.496.

The estimated difference is therefore approximately half a standard deviation. The correction is small because the combined sample is reasonably large.

If both groups’ scores are transformed using y=a+bxy=a+bx, with b>0b>0, both the mean difference and standard deviations are multiplied by bb, so the SMD is unchanged. A negative bb reverses its sign. Nonlinear transformations generally change its magnitude.

Sampling uncertainty and hypothesis tests

An SMD is an estimate with sampling uncertainty. Its precision depends on sample size, group allocation, the underlying distributions, and the denominator used.

For independent groups under the equal-variance model, one common large-sample approximation is

Var⁡^(d)≈n1+n0n1n0+d22(n1+n0−2).\widehat{\operatorname{Var}}(d) \approx \frac{n_1+n_0}{n_1n_0} + \frac{d^2}{2(n_1+n_0-2)}.

An approximate variance for the corresponding gg is obtained by multiplying this expression by J(ν)2J(\nu)^2. More refined estimators use different finite-sample adjustments.

The standard error is the square root of the estimated sampling variance. A normal-approximation confidence interval takes the form

g±z1−α/2SE⁡(g),g\pm z_{1-\alpha/2}\operatorname{SE}(g),

where z1−α/2z_{1-\alpha/2} is the appropriate standard-normal quantile.

For the usual pooled two-sample tt-test,

t=d1/n1+1/n0.t=\frac{d}{\sqrt{1/n_1+1/n_0}}.

Under independent normal observations with equal variances, this statistic has a noncentral Student’s tt-distribution when the population difference is nonzero. Its noncentrality parameter is

λ=δ1/n1+1/n0.\lambda=\frac{\delta}{\sqrt{1/n_1+1/n_0}}.

Inverting that distribution provides confidence intervals for δ\delta that need not be symmetric around the estimated effect.

The SMD and statistical significance answer different questions. A small effect can be estimated precisely in a large sample, while a larger estimated effect can remain uncertain in a small sample. A p-value is therefore not a substitute for reporting the effect size and its uncertainty.

Paired and repeated-measures data

For paired observations, such as measurements before and after an intervention, the denominator requires particular care.

Let Di=Xi,post−Xi,preD_i=X_{i,\mathrm{post}}-X_{i,\mathrm{pre}}. One standardized change measure is

dz=DˉsD,d_z=\frac{\bar{D}}{s_D},

where sDs_D is the standard deviation of individual differences. Because

sD2=spre2+spost2−2r sprespost,s_D^2 = s_{\mathrm{pre}}^2+s_{\mathrm{post}}^2 - 2r\,s_{\mathrm{pre}}s_{\mathrm{post}},

the correlation rr between measurements affects the magnitude of dzd_z.

Other measures standardize the mean change by a baseline standard deviation or an average of the pre- and post-measurement variances. These estimate different quantities. A paired-sample SMD standardized by change-score variability is not directly interchangeable with an independent-groups SMD standardized by between-person variability.

The standardizer and the study design must therefore be identified when comparing or combining standardized effects. Within-group change also does not, by itself, establish an intervention effect.

Use in meta-analysis

SMDs allow studies to be combined when they measure a sufficiently similar construct using different instruments—for example, different tests intended to assess the same skill. Before pooling, score directions must be aligned so that positive and negative values have consistent meanings.

A common inverse-variance pooled estimate is

θ^=∑iwigi∑iwi.\hat{\theta} = \frac{\sum_i w_i g_i}{\sum_i w_i}.

In a common-effect model, wi=1/viw_i=1/v_i, where viv_i is the estimated sampling variance. In a random-effects model, weights commonly take the form

wi=1vi+τ2,w_i=\frac{1}{v_i+\tau^2},

where τ2\tau^2 represents between-study effect heterogeneity.

Standardization removes measurement units, but it does not guarantee substantive comparability. Different instruments may capture different constructs or differ in measurement reliability. Populations may also differ in variability: the same raw mean difference yields a larger SMD in a more homogeneous population.

Effects from studies sharing participants, comparison groups, or outcomes are statistically dependent. Their synthesis requires accounting for that dependence rather than treating all estimates as independent.

Use in assessing covariate balance

In causal inference, standardized differences are used to compare covariates between groups before and after matching or weighting. For a continuous covariate, a common definition is

SMD⁡bal=xˉ1−xˉ0(s12+s02)/2.\operatorname{SMD}_{\mathrm{bal}} = \frac{\bar{x}_1-\bar{x}_0} {\sqrt{(s_1^2+s_0^2)/2}}.

Unlike the degrees-of-freedom-weighted denominator used in the usual Cohen’s dd, this denominator gives equal weight to the two group variances. Other conventions use a baseline or reference-group standard deviation.

For a binary covariate, one convention replaces the means by proportions and the variances by p(1−p)p(1-p):

SMD⁡binary=p1−p0{p1(1−p1)+p0(1−p0)}/2.\operatorname{SMD}_{\mathrm{binary}} = \frac{p_1-p_0} {\sqrt{\{p_1(1-p_1)+p_0(1-p_0)\}/2}}.

Absolute standardized differences are commonly used as descriptive balance diagnostics rather than significance tests. A threshold such as 0.10.1 is a convention, not proof that confounding has been eliminated. Equal means can coexist with different variances, distributional shapes, or relationships among covariates, and balance on measured variables does not establish balance on unmeasured variables.

Interpretation and limitations

Conventional benchmarks associated with Cohen describe absolute values around 0.20.2, 0.50.5, and 0.80.8 as small, medium, and large. These are rough conventions rather than universal standards. Practical importance depends on the outcome, population, costs, and substantive context.

Several limitations are especially important:

  • Dependence on variability. The denominator reflects population heterogeneity and measurement properties, not just the size of the mean difference.
  • Unequal variances. When population variances differ, a common-standard-deviation interpretation may be inappropriate. The pooled denominator can also depend on the relative group sizes.
  • Sensitivity to extreme observations. Both means and standard deviations can be strongly affected by outliers. Robust alternatives generally define different effect measures.
  • Limited distributional information. An SMD describes standardized mean separation, not all differences between distributions or the probability that one observation exceeds another without additional assumptions.
  • No automatic causal meaning. Standardizing a difference does not remove selection effects, confounding, or other sources of bias.
  • Undefined or unstable denominators. A zero reference standard deviation makes the measure undefined; a poorly estimated denominator can make the estimate unstable.

Reporting the raw means, standard deviations, sample sizes, direction of subtraction, standardization convention, and uncertainty interval makes an SMD interpretable and reproducible.