The Cauchy distribution is a continuous probability distribution characterized by a central peak and unusually heavy tails. Its location parameter specifies the center, and its scale parameter specifies the width. Despite its symmetry, it has neither a defined mean nor a defined variance. It is an important example of why familiar statistical procedures, particularly averaging, require assumptions about the underlying distribution. Named after Augustin-Louis Cauchy, it is also known as the Lorentzian distribution in physics, where its shape describes many resonance and spectral profiles.
Definition and parameters
A random variable has a Cauchy distribution with location and scale , written
if its probability density function is
The density is symmetric about , which is both its unique mode and its median. Its maximum is . At , the density is half its maximum, so the full width at half maximum is .
The standard Cauchy distribution has and :
If is standard Cauchy, then has distribution .
The scale is not a standard deviation: the latter does not exist for this distribution.
Distribution function and quantiles
The cumulative distribution function is
Its inverse, the quantile function, is
Consequently, the first and third quartiles are and , giving an interquartile range of . Exactly half of the probability lies within one scale parameter of the center:
More generally,
Heavy tails and nonexistent moments
For large , the density behaves as
Equivalently, its two-sided tail probability satisfies
These power-law tails are much heavier than those of a normal distribution. Extreme observations are therefore substantially more frequent.
Why symmetry does not give a mean
For a standard Cauchy variable , the positive and negative parts of the first-moment integral diverge separately:
Thus its expected value is undefined, rather than zero or infinite.
Symmetric truncation nevertheless gives
This is a Cauchy principal value, not an ordinary expectation. Cancellation under a prescribed truncation rule does not make the random variable integrable. The distinction is a standard example of the importance of convergence conditions in integration.
The variance is also undefined, and the second moment about any fixed finite center diverges. No positive integer-order moment exists as a finite expectation. Fractional absolute moments do exist below order one:
For , the absolute moment diverges.
The moment-generating function is not finite for any nonzero real argument. By contrast, the characteristic function exists for every real argument.
Characteristic function and stability
The characteristic function is
The absolute value in the exponent produces a cusp at the origin, consistent with the absence of a finite first absolute moment.
The Cauchy distribution is a stable distribution with stability index . If are independent and
then
More generally, for real coefficients , not all zero,
Thus independent Cauchy variables remain Cauchy under nondegenerate linear combinations. Equivalently, the convolution of two Cauchy densities is another Cauchy density, with locations and scales added.
Why averaging does not concentrate
If are independent observations from the same distribution, their sample mean satisfies
for every .
Its distribution does not become narrower as the sample size increases. For every ,
which does not tend to zero. Hence the sample mean does not converge in probability to the location parameter.
This does not contradict the law of large numbers or the usual central limit theorem: the relevant moment assumptions are not satisfied. Stability instead makes the Cauchy distribution a limiting law under other normalization schemes.
Constructions and related distributions
Ratio of normal variables
If and are independent standard normal variables, then
The denominator is zero with probability zero, so the ratio is defined almost surely. Values of the denominator close to zero explain the possibility of very large ratios.
This construction also identifies the standard Cauchy distribution as Student’s -distribution with one degree of freedom. Ratios of normal variables with nonzero means are not, in general, Cauchy.
Tangent of a uniform angle
If
then is standard Cauchy. Geometrically, a line through a fixed point with a uniformly distributed direction produces a Cauchy-distributed intercept on a suitable perpendicular line.
The quantile formula gives a direct simulation method. For having the uniform distribution on ,
has the desired Cauchy distribution. In numerical implementations, endpoint values must be excluded because the tangent diverges there.
Reciprocal transformation
For a standard Cauchy variable ,
More generally, if , then
The reciprocal is defined almost surely because the distribution assigns zero probability to .
Statistical estimation
The lack of a mean does not prevent estimation of location and scale. It does, however, make sample-moment methods unsuitable.
Quantile-based estimation
The sample median is a consistent estimator of . For large samples, its limiting distribution is
Thus the median can concentrate around the center even though the sample mean does not.
Half the sample interquartile range consistently estimates . The sample median absolute deviation from the sample median also consistently estimates , without the normal-distribution calibration factor sometimes applied to that statistic.
Maximum likelihood
For independent observations , the log-likelihood is
Maximum likelihood estimation generally requires numerical optimization. The likelihood is not globally concave in the location parameter and can have multiple stationary points, so numerical procedures must distinguish local from global solutions.
With known scale, the location score equation is
Very large residuals contribute less to this equation than moderately sized residuals. This contrasts with least-squares estimation, where the contribution of a residual grows with its magnitude.
For one observation, the Fisher information matrix for is
Thus finite information about the parameters can coexist with nonexistent moments of the observations.
Applications and limitations
Spectral and resonance profiles
In spectroscopy, the Cauchy density’s shape is commonly called a Lorentzian profile. The center represents a resonance frequency, and is the full width at half maximum. Physical line profiles need not be normalized as probability densities, but their dependence on frequency can have the same mathematical form.
A causal exponentially damped oscillation has a frequency-domain amplitude whose squared magnitude is Lorentzian. This connects exponential decay in time with Lorentzian resonance profiles through the Fourier transform. When independent Gaussian and Lorentzian broadening mechanisms combine, the resulting convolution is a Voigt profile, rather than a pure Cauchy profile.
Heavy-tailed statistical models
Cauchy errors can model data with occasional very large deviations when Gaussian tails are inadequate. The same heavy tails also make means, variances, and mean-squared-error calculations inappropriate unless the quantities being analyzed have separately established finite moments.
In Bayesian inference, the Cauchy distribution is used as a proper heavy-tailed prior distribution for some location or regression parameters. Its flexibility permits large parameter values, but prior scale remains consequential, and existence of posterior moments must be checked rather than assumed.
For simulation and statistical computation, the distribution illustrates an important distinction: generating more observations does not make every summary more stable. Quantile estimates can improve with sample size while the arithmetic mean retains exactly the same Cauchy distribution.