The Laplace distribution is a continuous probability distribution on the real line whose density decreases exponentially with distance from a central location. It is symmetric, has a sharp peak at its center, and has heavier tails than the normal distribution. Named after Pierre-Simon Laplace, it is also called the double exponential distribution because its two halves have exponential form. Its connection with absolute deviations makes it important in statistical estimation, regression, sparse modeling, and privacy-preserving computation.
Definition and parameterization
A random variable has a Laplace distribution with location parameter and scale parameter , written
if its probability density function is
The parameter determines the center, while controls the spread. The standard Laplace distribution has and . If has the standard distribution, then
has distribution .
Some sources use the rate parameter , giving
Distinguishing scale from rate is essential when comparing formulas or software implementations.
The density is continuous everywhere but is not differentiable at . Its logarithm consists of two straight-line segments meeting at the center.
Distribution function and quantiles
The cumulative distribution function is
Its quantile function, for , is
For any ,
Consequently, a central interval containing probability , where , is
This is a probability interval for a random observation under known parameters, not automatically a confidence interval for an unknown parameter.
Moments and shape
The expected value, median, and mode all equal . The variance and standard deviation are
The scale also has a direct interpretation as the mean absolute deviation from the center:
More generally,
where is the gamma function. All odd central moments vanish by symmetry, while
The distribution has skewness zero, kurtosis , and excess kurtosis .
Compared with a normal distribution having the same variance, a Laplace distribution has both a higher central peak and more probability far into the tails. Nevertheless, it is not heavy-tailed in the technical sense that excludes distributions with a finite moment-generating function near zero: its tails decay exponentially rather than as a power law.
The differential entropy, using natural logarithms, is
Among real-valued distributions with a fixed value of , the Laplace distribution maximizes differential entropy.
Transforms and probabilistic representations
The moment-generating function is
The characteristic function is
Several constructions explain the distribution’s structure.
Difference of exponential variables
If and are independent exponential random variables, each with mean , then
Equivalently, if is exponential with mean , and independently takes the values and with equal probability, then
Thus is exponentially distributed.
Normal variance mixture
Let , and independently let be exponential with mean . Then
has a Laplace distribution. Conditional on , the distribution is normal with variance . This representation is useful for hierarchical models and computational methods in Bayesian inference.
Sums and limiting behavior
A sum of independent Laplace variables is generally not itself Laplace. For example, the characteristic function of the sum of independent variables is
rather than the characteristic function of another Laplace variable.
Because its variance is finite, the usual central limit theorem applies to independent, identically distributed Laplace observations: appropriately standardized sums converge in distribution to a normal distribution.
Parameter estimation
For independent observations , the log-likelihood is
Maximum likelihood
For fixed , maximum likelihood estimation of minimizes the sum of absolute deviations:
Therefore, any sample median is a maximum-likelihood estimate. For an even sample size, every point between the two middle ordered observations is a minimizer.
Given such an estimate,
When the observations are not all identical, these give joint maximum-likelihood estimates. If all observations coincide, the likelihood is unbounded as is placed at their common value and tends to zero, so no finite maximum exists within the parameter space .
Efficiency and robustness
Under the Laplace model, the sample median has asymptotic variance
whereas the sample mean has variance . Thus the median is asymptotically more efficient for estimating the location under this model.
The median is also resistant to extreme observations. This robustness does not extend automatically to every Laplace-based procedure: the scale estimate remains sensitive to sufficiently large observations, and regression methods based on absolute residuals can still be sensitive to unusual predictor values.
Applications
Absolute-error regression
Suppose a linear regression model has errors that, conditional on the predictors, are independent Laplace variables with common scale:
Maximizing the likelihood over is equivalent to minimizing
This is least absolute deviations regression. Unlike ordinary least squares, it uses an absolute-error loss function rather than a squared-error loss. Large residuals therefore contribute linearly rather than quadratically to the objective.
Sparse Bayesian modeling
Independent Laplace prior distributions on regression coefficients have joint density proportional to
With a Gaussian observation model, maximum a posteriori estimation then minimizes a squared-error term plus an penalty, producing the optimization criterion of lasso regression.
The resulting mode can have coefficients exactly equal to zero. A continuous Laplace prior, however, does not itself assign positive probability to a coefficient being exactly zero; sparsity of a posterior mode differs from a discrete posterior probability of exclusion.
Differential privacy
The Laplace mechanism is a basic construction in differential privacy. For a real-valued query , define its sensitivity by
where denotes neighboring datasets under a specified adjacency relation.
When the sensitivity is finite and positive, releasing
provides -differential privacy. The guarantee follows from a bound on the ratio of output densities for neighboring datasets. A zero-sensitivity query requires no noise.
Simulation and related distributions
Laplace samples can be generated directly by applying the quantile function to a variable with a uniform distribution on . They can also be generated using the difference-of-exponentials or random-sign representations. Implementations must handle endpoints carefully because the quantile function diverges at probabilities zero and one.
The asymmetric Laplace distribution allows different exponential decay rates on the two sides of its peak and is used in quantile regression. Multivariate extensions also exist, but different constructions produce different dependence structures; there is no single universally intended multivariate Laplace model.
The term “double exponential” can also describe an exponential-of-an-exponential expression in other mathematical contexts. In probability, the distribution’s density or parameterization should therefore be specified when ambiguity is possible.
As a statistical model, the symmetric Laplace distribution imposes equal left and right tail behavior and exponential tail decay. It may be unsuitable for strongly skewed data or power-law tails, while its cusp at the center distinguishes it from smooth-peaked alternatives. It is also distinct from the Laplace transform and from Laplace approximations used to approximate integrals, despite their shared name.