The Marchenko–Pastur law is a fundamental result in random matrix theory describing the limiting distribution of the eigenvalues of large sample covariance matrices. When the number of measured variables and the number of observations increase at comparable rates, the eigenvalues generally remain spread over a nontrivial interval, even when the underlying variables are independent and have equal variance. The law specifies this spread and, when there are more variables than observations, the proportion of eigenvalues equal to zero. It was established by Vladimir Marchenko and Leonid Pastur in 1967.
Setting and statement
Let be a real matrix, whose columns represent observations of variables. Assume that its entries are independent and identically distributed, with mean zero and variance . Define
where denotes the transpose. For complex entries, the transpose is replaced by the conjugate transpose, and the variance means .
The matrix is an uncentered sample covariance matrix. Its eigenvalues are nonnegative. Their empirical spectral distribution is
where is a unit point mass at . This distribution gives equal weight to every eigenvalue, including any zeros.
Suppose that
In the standard independent, identically distributed model, finite variance is sufficient for to converge almost surely, in the sense of weak convergence, to a deterministic probability distribution .
This means that, for every bounded continuous function ,
almost surely. The theorem concerns the distribution of the eigenvalues collectively; it does not, by itself, establish convergence of the largest or smallest eigenvalue.
Density and point mass at zero
Define the spectral edges
The Marchenko–Pastur distribution is
where , and is the indicator function of the interval .
The continuous part has a density supported between and . Its total mass is when , and when .
Fewer variables than observations:
There is no point mass at zero, and the lower edge is strictly positive:
Nevertheless, the limiting eigenvalues are not all equal to the population variance . Sampling variability produces a persistent spectral spread because the dimension increases with the sample size.
Equal asymptotic dimensions:
The support is , and the density becomes
It diverges as near zero, but the divergence is integrable. There is no point mass at zero.
More variables than observations:
The law has a point mass of size at zero. This follows from rank:
Thus, when , at least eigenvalues are exactly zero, and their proportion approaches . The continuous component remains separated from zero because .
Normalization conventions
Different references use different aspect ratios and matrix normalizations. The density must be interpreted together with these choices.
For , this article uses
and assigns mass to each eigenvalue.
The companion Gram matrix
has the same nonzero eigenvalues as , but it is . Consequently, its empirical distribution has different weights and a different number of zero eigenvalues. At finite dimensions,
When , the negative coefficient in this algebraic identity cancels part of the zero mass already present in ; the resulting measure is still a probability measure.
Some presentations instead normalize by or define the aspect ratio as . These choices rescale the edges or reverse the parameter convention. Apparent discrepancies between formulas often arise from these differences.
Interpretation in high-dimensional statistics
If the columns of have population covariance , where is the identity matrix, every population eigenvalue equals . In fixed dimension, the sample covariance matrix approaches the population covariance as increases.
The proportional-growth regime is different. With , noise alone produces sample eigenvalues throughout the Marchenko–Pastur bulk. A broad spectrum therefore does not necessarily indicate unequal population variances or genuine correlation structure.
For example, if and , then
Thus, under an isotropic independent-noise model, the bulk extends from to , despite every population eigenvalue being .
As tends to zero, both edges approach , and the limiting distribution approaches . This connects the high-dimensional regime to the classical regime in which the number of observations greatly exceeds the number of variables.
Centering observations
In applications, covariance matrices are usually formed after subtracting the sample mean. If is the mean observation vector, the centered matrix with normalization is
Centering changes the matrix by rank at most one. It therefore does not change the limiting empirical spectral distribution. Replacing by also leaves the limiting law unchanged, although both choices affect finite-sample quantities.
Moments and transform characterization
The mean and variance of the Marchenko–Pastur distribution, viewed as a distribution over eigenvalues, are
and
The second formula measures spectral dispersion; it is distinct from the variance of the data entries.
For an integer , its -th moment is
In particular,
These are moments of the limiting measure. Convergence of high-order empirical moments requires stronger assumptions than weak convergence alone.
Another characterization uses the Stieltjes transform
It satisfies
The relevant solution has positive imaginary part in the upper half-plane and satisfies at infinity. The density can be recovered from its boundary values:
at interior points of the continuous spectrum.
Why the law appears
Two principal approaches explain the limiting distribution.
The moment method
The normalized trace
is the -th empirical spectral moment. Expanding the trace gives sums of products of entries of .
Independence and zero means eliminate many terms. Among those remaining, certain index patterns dominate as and increase proportionally. Their counting yields the moment formula above. In treatments that begin with sufficiently strong moment assumptions, concentration arguments establish convergence of the empirical moments; truncation arguments help extend the distributional result to weaker assumptions.
Resolvent methods
The resolvent is the matrix
Its normalized trace is the empirical Stieltjes transform:
Resolvent identities and concentration estimates lead to a limiting self-consistency equation. In the isotropic independent-entry case, this becomes the quadratic equation for . Resolvent methods also extend naturally to nonidentity population covariance matrices.
Applications and extensions
Principal component analysis
In principal component analysis, sample covariance eigenvalues quantify the variance associated with principal components. The Marchenko–Pastur law provides a benchmark for the bulk spectrum generated by high-dimensional isotropic noise.
The upper edge is a limiting bulk boundary, not an exact finite-sample significance threshold. In particular, a sample eigenvalue slightly above does not by itself establish a non-noise component. Appropriate inference requires a specified model and finite-sample or fluctuation theory.
Spiked covariance models
A spiked covariance model introduces a small number of population eigenvalues different from the background value. Such finite-rank changes generally leave the limiting bulk distribution unchanged, but sufficiently strong spikes can produce isolated sample eigenvalues.
For unit background variance, under standard spiked-model assumptions, a population eigenvalue produces an upper outlier whose limit is
A spike below this threshold does not separate from the upper bulk edge. This illustrates why a genuine population component need not appear as a visibly isolated sample eigenvalue.
Regularization and numerical conditioning
When approaches , the lower spectral edge approaches zero. Under conditions ensuring convergence of the extreme eigenvalues, this corresponds to poor conditioning of sample covariance matrices. For , these matrices are necessarily singular.
The law helps analyze spectral regularization, including the effect of replacing by . It also appears in asymptotic calculations for ridge regression, estimation risk, and linear inverse problems.
Gaussian and non-Gaussian data
For Gaussian entries, the unnormalized matrix has a Wishart distribution. The Marchenko–Pastur law gives its proportional-dimensional spectral limit after normalization.
Gaussianity is not essential. The same limiting law holds for a wide class of independent-entry distributions. This robustness is an example of universality, although bulk convergence, edge convergence, and fluctuation laws require different assumptions.
Scope and limitations
The standard law assumes an isotropic population and suitable independence. If the population covariance has a nontrivial limiting spectrum, the sample spectrum generally follows a deformed Marchenko–Pastur law rather than the density given above.
Dependence between observations or coordinates, unequal entry variances, and sparse sampling can also change the limit. If the entries have infinite variance, the usual normalization and limiting distribution need not apply.
Bulk convergence does not control individual extremes. A vanishing fraction of very large eigenvalues can leave the empirical spectral limit unchanged. Under stronger assumptions, such as a finite fourth moment in the standard independent-entry model, extreme-eigenvalue results establish convergence of the largest eigenvalue to , and, for , of the smallest eigenvalue to .
Finally, the law is asymptotic. Finite matrices exhibit deviations from the limiting density and fluctuations near the edges. Those questions require additional results beyond the Marchenko–Pastur theorem itself.