{
  "id": "laplace-distribution",
  "title": "Laplace Distribution",
  "lang": "en",
  "source_lang": "en",
  "summary": "The Laplace distribution is a symmetric continuous probability distribution with an exponential decay on either side of its central peak, used in statistical modeling, robust estimation, sparse inference, and differential privacy.",
  "category": "mathematics",
  "subcategory": "probability-statistics",
  "type": "concept",
  "aliases": [
    "Double exponential distribution",
    "Bilateral exponential distribution"
  ],
  "generated_at": "2026-11-05",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/laplace-distribution/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/laplace-distribution/",
      "json": "https://aiwiki.page/zh/laplace-distribution.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "The Laplace distribution is a continuous probability distribution on the real line whose density decreases exponentially with distance from a central location. It is symmetric, has a sharp peak at its center, and has heavier tails than the normal distribution. Named after Pierre-Simon Laplace, it is also called the double exponential distribution because its two halves have exponential form. Its connection with absolute deviations makes it important in statistical estimation, regression, sparse modeling, and privacy-preserving computation."
    },
    {
      "heading": "Definition and parameterization",
      "text": "A random variable \\(X\\) has a Laplace distribution with location parameter \\(\\mu\\in\\mathbb{R}\\) and scale parameter \\(b>0\\), written\n\n\\[X\\sim\\operatorname{Laplace}(\\mu,b),\\]\n\nif its probability density function is\n\n\\[f(x\\mid\\mu,b) =\\frac{1}{2b}\\exp\\!\\left(-\\frac{|x-\\mu|}{b}\\right), \\qquad x\\in\\mathbb{R}.\\]\n\nThe parameter \\(\\mu\\) determines the center, while \\(b\\) controls the spread. The standard Laplace distribution has \\(\\mu=0\\) and \\(b=1\\). If \\(Z\\) has the standard distribution, then\n\n\\[X=\\mu+bZ\\]\n\nhas distribution \\(\\operatorname{Laplace}(\\mu,b)\\).\n\nSome sources use the rate parameter \\(\\lambda=1/b\\), giving\n\n\\[f(x\\mid\\mu,\\lambda) =\\frac{\\lambda}{2}e^{-\\lambda|x-\\mu|}.\\]\n\nDistinguishing scale from rate is essential when comparing formulas or software implementations.\n\nThe density is continuous everywhere but is not differentiable at \\(x=\\mu\\). Its logarithm consists of two straight-line segments meeting at the center."
    },
    {
      "heading": "Distribution function and quantiles",
      "text": "The cumulative distribution function is\n\n\\[F(x)= \\begin{cases} \\dfrac12\\exp\\!\\left(\\dfrac{x-\\mu}{b}\\right),&x<\\mu,\\\\[6pt] 1-\\dfrac12\\exp\\!\\left(-\\dfrac{x-\\mu}{b}\\right),&x\\geq\\mu. \\end{cases}\\]\n\nIts quantile function, for \\(0<p<1\\), is\n\n\\[F^{-1}(p)= \\begin{cases} \\mu+b\\ln(2p),&0<p\\leq \\dfrac12,\\\\[6pt] \\mu-b\\ln\\!\\bigl(2(1-p)\\bigr),&\\dfrac12<p<1. \\end{cases}\\]\n\nFor any \\(a\\geq0\\),\n\n\\[\\Pr(|X-\\mu|>a)=e^{-a/b}.\\]\n\nConsequently, a central interval containing probability \\(1-\\alpha\\), where \\(0<\\alpha<1\\), is\n\n\\[\\left[\\mu-b\\ln(1/\\alpha),\\ \\mu+b\\ln(1/\\alpha)\\right].\\]\n\nThis is a probability interval for a random observation under known parameters, not automatically a confidence interval for an unknown parameter."
    },
    {
      "heading": "Moments and shape",
      "text": "The expected value, median, and mode all equal \\(\\mu\\). The variance and standard deviation are\n\n\\[\\operatorname{Var}(X)=2b^2, \\qquad \\operatorname{SD}(X)=\\sqrt{2}\\,b.\\]\n\nThe scale also has a direct interpretation as the mean absolute deviation from the center:\n\n\\[\\mathbb{E}|X-\\mu|=b.\\]\n\nMore generally,\n\n\\[\\mathbb{E}|X-\\mu|^r=b^r\\Gamma(r+1), \\qquad r>-1,\\]\n\nwhere \\(\\Gamma\\) is the gamma function. All odd central moments vanish by symmetry, while\n\n\\[\\mathbb{E}(X-\\mu)^{2k}=(2k)!\\,b^{2k}.\\]\n\nThe distribution has skewness zero, kurtosis \\(6\\), and excess kurtosis \\(3\\).\n\nCompared with a normal distribution having the same variance, a Laplace distribution has both a higher central peak and more probability far into the tails. Nevertheless, it is not heavy-tailed in the technical sense that excludes distributions with a finite moment-generating function near zero: its tails decay exponentially rather than as a power law.\n\nThe differential entropy, using natural logarithms, is\n\n\\[h(X)=1+\\ln(2b).\\]\n\nAmong real-valued distributions with a fixed value of \\(\\mathbb{E}|X-\\mu|=b\\), the Laplace distribution maximizes differential entropy."
    },
    {
      "heading": "Transforms and probabilistic representations",
      "text": "The moment-generating function is\n\n\\[M_X(t)=\\mathbb{E}[e^{tX}] =\\frac{e^{\\mu t}}{1-b^2t^2}, \\qquad |t|<1/b.\\]\n\nThe characteristic function is\n\n\\[\\varphi_X(t)=\\mathbb{E}[e^{itX}] =\\frac{e^{i\\mu t}}{1+b^2t^2}, \\qquad t\\in\\mathbb{R}.\\]\n\nSeveral constructions explain the distribution’s structure.\n\nDifference of exponential variables\n\nIf \\(E_1\\) and \\(E_2\\) are independent exponential random variables, each with mean \\(b\\), then\n\n\\[\\mu+E_1-E_2\\sim\\operatorname{Laplace}(\\mu,b).\\]\n\nEquivalently, if \\(E\\) is exponential with mean \\(b\\), and \\(S\\) independently takes the values \\(-1\\) and \\(1\\) with equal probability, then\n\n\\[\\mu+SE\\sim\\operatorname{Laplace}(\\mu,b).\\]\n\nThus \\(|X-\\mu|\\) is exponentially distributed.\n\nNormal variance mixture\n\nLet \\(Z\\sim N(0,1)\\), and independently let \\(V\\) be exponential with mean \\(2b^2\\). Then\n\n\\[X=\\mu+\\sqrt{V}\\,Z\\]\n\nhas a Laplace distribution. Conditional on \\(V\\), the distribution is normal with variance \\(V\\). This representation is useful for hierarchical models and computational methods in Bayesian inference.\n\nSums and limiting behavior\n\nA sum of independent Laplace variables is generally not itself Laplace. For example, the characteristic function of the sum of \\(n\\) independent \\(\\operatorname{Laplace}(0,b)\\) variables is\n\n\\[(1+b^2t^2)^{-n},\\]\n\nrather than the characteristic function of another Laplace variable.\n\nBecause its variance is finite, the usual central limit theorem applies to independent, identically distributed Laplace observations: appropriately standardized sums converge in distribution to a normal distribution."
    },
    {
      "heading": "Parameter estimation",
      "text": "For independent observations \\(x_1,\\ldots,x_n\\), the log-likelihood is\n\n\\[\\ell(\\mu,b) =-n\\ln(2b)-\\frac{1}{b}\\sum_{i=1}^{n}|x_i-\\mu|.\\]\n\nMaximum likelihood\n\nFor fixed \\(b\\), maximum likelihood estimation of \\(\\mu\\) minimizes the sum of absolute deviations:\n\n\\[\\widehat{\\mu}\\in \\operatorname*{arg\\,min}_{m\\in\\mathbb{R}} \\sum_{i=1}^{n}|x_i-m|.\\]\n\nTherefore, any sample median is a maximum-likelihood estimate. For an even sample size, every point between the two middle ordered observations is a minimizer.\n\nGiven such an estimate,\n\n\\[\\widehat b =\\frac1n\\sum_{i=1}^{n}|x_i-\\widehat\\mu|.\\]\n\nWhen the observations are not all identical, these give joint maximum-likelihood estimates. If all observations coincide, the likelihood is unbounded as \\(\\mu\\) is placed at their common value and \\(b\\) tends to zero, so no finite maximum exists within the parameter space \\(b>0\\).\n\nEfficiency and robustness\n\nUnder the Laplace model, the sample median has asymptotic variance\n\n\\[\\operatorname{Var}(\\widehat\\mu)\\sim\\frac{b^2}{n},\\]\n\nwhereas the sample mean has variance \\(2b^2/n\\). Thus the median is asymptotically more efficient for estimating the location under this model.\n\nThe median is also resistant to extreme observations. This robustness does not extend automatically to every Laplace-based procedure: the scale estimate remains sensitive to sufficiently large observations, and regression methods based on absolute residuals can still be sensitive to unusual predictor values."
    },
    {
      "heading": "Applications",
      "text": "Absolute-error regression\n\nSuppose a linear regression model has errors that, conditional on the predictors, are independent Laplace variables with common scale:\n\n\\[y_i=x_i^{\\mathsf T}\\beta+\\varepsilon_i, \\qquad \\varepsilon_i\\sim\\operatorname{Laplace}(0,b).\\]\n\nMaximizing the likelihood over \\(\\beta\\) is equivalent to minimizing\n\n\\[\\sum_i|y_i-x_i^{\\mathsf T}\\beta|.\\]\n\nThis is least absolute deviations regression. Unlike ordinary least squares, it uses an absolute-error loss function rather than a squared-error loss. Large residuals therefore contribute linearly rather than quadratically to the objective.\n\nSparse Bayesian modeling\n\nIndependent Laplace prior distributions on regression coefficients have joint density proportional to\n\n\\[\\exp\\!\\left(-\\lambda\\sum_j|\\beta_j|\\right).\\]\n\nWith a Gaussian observation model, maximum a posteriori estimation then minimizes a squared-error term plus an \\(L^1\\) penalty, producing the optimization criterion of lasso regression.\n\nThe resulting mode can have coefficients exactly equal to zero. A continuous Laplace prior, however, does not itself assign positive probability to a coefficient being exactly zero; sparsity of a posterior mode differs from a discrete posterior probability of exclusion.\n\nDifferential privacy\n\nThe Laplace mechanism is a basic construction in differential privacy. For a real-valued query \\(q\\), define its sensitivity by\n\n\\[\\Delta_1q =\\sup_{D\\sim D'}|q(D)-q(D')|,\\]\n\nwhere \\(D\\sim D'\\) denotes neighboring datasets under a specified adjacency relation.\n\nWhen the sensitivity is finite and positive, releasing\n\n\\[q(D)+Z, \\qquad Z\\sim\\operatorname{Laplace}\\!\\left(0,\\frac{\\Delta_1q}{\\varepsilon}\\right),\\]\n\nprovides \\(\\varepsilon\\)-differential privacy. The guarantee follows from a bound on the ratio of output densities for neighboring datasets. A zero-sensitivity query requires no noise."
    },
    {
      "heading": "Simulation and related distributions",
      "text": "Laplace samples can be generated directly by applying the quantile function to a variable with a uniform distribution on \\((0,1)\\). They can also be generated using the difference-of-exponentials or random-sign representations. Implementations must handle endpoints carefully because the quantile function diverges at probabilities zero and one.\n\nThe asymmetric Laplace distribution allows different exponential decay rates on the two sides of its peak and is used in quantile regression. Multivariate extensions also exist, but different constructions produce different dependence structures; there is no single universally intended multivariate Laplace model.\n\nThe term “double exponential” can also describe an exponential-of-an-exponential expression in other mathematical contexts. In probability, the distribution’s density or parameterization should therefore be specified when ambiguity is possible.\n\nAs a statistical model, the symmetric Laplace distribution imposes equal left and right tail behavior and exponential tail decay. It may be unsuitable for strongly skewed data or power-law tails, while its cusp at the center distinguishes it from smooth-peaked alternatives. It is also distinct from the Laplace transform and from Laplace approximations used to approximate integrals, despite their shared name."
    }
  ],
  "links": [
    "probability-distribution",
    "normal-distribution",
    "pierre-simon-laplace",
    "random-variable",
    "probability-density-function",
    "cumulative-distribution-function",
    "quantile",
    "confidence-interval",
    "expected-value",
    "median",
    "variance",
    "standard-deviation",
    "gamma-function",
    "differential-entropy",
    "exponential-distribution",
    "bayesian-inference",
    "central-limit-theorem",
    "likelihood-function",
    "maximum-likelihood-estimation",
    "sample-mean",
    "linear-regression",
    "ordinary-least-squares",
    "loss-function",
    "prior-distribution",
    "maximum-a-posteriori-estimation",
    "lasso-regression",
    "differential-privacy",
    "uniform-distribution",
    "laplace-transform"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}