{
  "id": "heavy-tailed-distribution",
  "title": "Heavy-Tailed Distribution",
  "lang": "en",
  "source_lang": "en",
  "summary": "A probability distribution whose tails lack exponential bounds, making extreme observations more likely than in exponentially decaying models.",
  "category": "mathematics",
  "subcategory": "probability-statistics",
  "type": "concept",
  "aliases": [
    "Heavy-tailed probability distribution"
  ],
  "generated_at": "2026-11-05",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/heavy-tailed-distribution/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/heavy-tailed-distribution/",
      "json": "https://aiwiki.page/zh/heavy-tailed-distribution.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "A heavy-tailed distribution is a probability distribution that assigns relatively substantial probability to very large observations. In a common mathematical definition, its right tail has no finite positive exponential moment: if \\(X\\) has the distribution, then \\(\\mathbb{E}[e^{tX}]=\\infty\\) for every \\(t>0\\). Heavy-tailed models describe situations in which rare, extreme observations can strongly influence totals, averages, and risk. The term is not completely standardized: some fields use it more loosely for distributions with heavier tails than the normal distribution, a broader comparison than the exponential-moment definition."
    },
    {
      "heading": "Definition and tail behavior",
      "text": "For a random variable \\(X\\) with cumulative distribution function \\(F\\), the right-tail or survival function is\n\n\\[\\overline F(x)=1-F(x)=\\Pr(X>x).\\]\n\nA standard definition calls the right tail heavy when\n\n\\[\\mathbb{E}[e^{tX}]=\\infty \\qquad\\text{for every }t>0.\\]\n\nA distribution is light-tailed under this convention if this expectation is finite for at least one positive \\(t\\). For a nonnegative random variable,\n\n\\[\\mathbb{E}[e^{tX}] = 1+t\\int_0^\\infty e^{tx}\\overline F(x)\\,dx,\\]\n\nwith both sides allowed to be infinite. This identity connects exponential moments directly to tail decay.\n\nEquivalently, a heavy right tail cannot satisfy an eventual bound\n\n\\[\\overline F(x)\\le C e^{-cx}\\]\n\nfor any constants \\(C,c>0\\). Another equivalent characterization is\n\n\\[\\limsup_{x\\to\\infty}e^{cx}\\overline F(x)=\\infty \\qquad\\text{for every }c>0.\\]\n\nThe use of a limit superior matters. Without additional regularity, a heavy tail need not decay smoothly or remain uniformly above every exponential curve. The informal phrase “decays more slowly than any exponential” should therefore be interpreted with care.\n\nFor distributions on the whole real line, right and left tails must be distinguished. A heavy left tail is defined by applying the right-tail criterion to \\(-X\\). A distribution may have one heavy tail or two; statements about absolute extremes often concern \\(\\Pr(|X|>x)\\).\n\nHeavy-tailedness is an asymptotic property, not simply a description of a few unusual data points. A distribution with bounded support is not heavy-tailed under this definition, however skewed or variable it appears within its finite range."
    },
    {
      "heading": "Major classes of heavy tails",
      "text": "Several important tail classes impose stronger structure than the basic absence of exponential moments.\n\nRegularly varying tails\n\nA right tail is regularly varying with index \\(-\\alpha\\), where \\(\\alpha>0\\), if\n\n\\[\\overline F(x)=x^{-\\alpha}L(x),\\]\n\nwhere \\(L\\) is slowly varying, meaning\n\n\\[\\frac{L(cx)}{L(x)}\\longrightarrow 1 \\qquad(x\\to\\infty)\\]\n\nfor every fixed \\(c>0\\). Equivalently,\n\n\\[\\frac{\\overline F(cx)}{\\overline F(x)} \\longrightarrow c^{-\\alpha}.\\]\n\nThis class includes exact power laws and distributions that approach power-law behavior after multiplication by a slowly varying factor. The exponent \\(\\alpha\\) measures tail decay: smaller positive values indicate heavier tails within this class.\n\nTerminology for a “tail index” varies. Some authors use \\(\\alpha\\); in extreme-value statistics, the corresponding index is often \\(\\xi=1/\\alpha\\).\n\nLong-tailed distributions\n\nA nonnegative distribution is long-tailed if, for every fixed \\(y>0\\),\n\n\\[\\frac{\\overline F(x+y)}{\\overline F(x)} \\longrightarrow 1.\\]\n\nThus, adding a fixed amount to an already large threshold changes the exceedance probability by a vanishing relative amount. Every long-tailed distribution is heavy-tailed, but the converse need not hold.\n\nSubexponential distributions\n\nA distribution on \\([0,\\infty)\\) is subexponential if, for independent copies \\(X_1\\) and \\(X_2\\),\n\n\\[\\Pr(X_1+X_2>x)\\sim 2\\overline F(x),\\]\n\nwhere \\(\\sim\\) means that the ratio tends to one. This is a statement about the tail of a convolution, not merely another name for slow exponential decay.\n\nMore generally, for each fixed positive integer \\(n\\),\n\n\\[\\Pr(X_1+\\cdots+X_n>x)\\sim n\\overline F(x).\\]\n\nThe interpretation is the principle of a single big jump: an exceptionally large sum is asymptotically most likely to result from one exceptionally large summand. These statements assume independence; dependence can substantially change the result.\n\nFor distributions on the nonnegative half-line, the inclusions are\n\n\\[\\{\\text{regularly varying tails with }\\alpha>0\\} \\subsetneq \\{\\text{subexponential distributions}\\} \\subsetneq \\{\\text{long-tailed distributions}\\} \\subsetneq \\{\\text{heavy-tailed distributions}\\}.\\]\n\nConsequently, properties proved for regularly varying or subexponential distributions cannot automatically be attributed to every heavy-tailed distribution."
    },
    {
      "heading": "Examples and counterexamples",
      "text": "Distribution | Tail behavior | Classification\n[[pareto-distribution | Pareto distribution]] | \\(\\overline F(x)=(x_m/x)^\\alpha\\) for \\(x\\ge x_m>0\\)\n[[students-t-distribution | Student’s \\(t\\)-distribution]] with \\(\\nu>0\\) degrees of freedom | Each tail is proportional asymptotically to \\(x^{-\\nu}\\)\n[[cauchy-distribution | Cauchy distribution]] | Each tail is proportional asymptotically to \\(x^{-1}\\)\n[[lognormal-distribution | Lognormal distribution]] | Decays faster than every inverse power but more slowly than every exponential in \\(x\\)\n[[weibull-distribution | Weibull distribution]] with survival \\(e^{-(x/\\lambda)^\\beta}\\), \\(0<\\beta<1\\) | Stretched-exponential decay\n[[exponential-distribution | Exponential distribution]] | \\(e^{-\\lambda x}\\)\nNormal distribution | Survival is asymptotically proportional to \\(x^{-1}e^{-x^2/2}\\) in the standard case | Light-tailed\n\nFor the Weibull family, \\(\\beta=1\\) gives the exponential distribution, while \\(\\beta>1\\) gives decay faster than exponential. Thus, a single distribution family can contain both heavy- and light-tailed members.\n\nThe word fat-tailed is sometimes used interchangeably with heavy-tailed, but sometimes specifically for power-law tails. Leptokurtic is also not synonymous with heavy-tailed: it usually refers to a fourth-moment comparison with the normal distribution. Some heavy-tailed distributions have no finite fourth moment, while some light-tailed distributions have high kurtosis."
    },
    {
      "heading": "Moments and sample averages",
      "text": "Heavy-tailedness does not imply that the mean or variance is infinite. It concerns exponential moments, which impose stronger integrability requirements than any fixed polynomial moment.\n\nFor nonnegative \\(X\\) and \\(p>0\\),\n\n\\[\\mathbb{E}[X^p] = p\\int_0^\\infty x^{p-1}\\overline F(x)\\,dx.\\]\n\nFor an exact Pareto distribution with exponent \\(\\alpha\\),\n\n\\[\\mathbb{E}[X^p]<\\infty \\quad\\Longleftrightarrow\\quad p<\\alpha.\\]\n\nAccordingly:\n\n- The mean is infinite when \\(\\alpha\\le1\\).\n- The mean is finite but the variance is infinite when \\(1<\\alpha\\le2\\).\n- The variance is finite when \\(\\alpha>2\\), although sufficiently high moments remain infinite.\n\nFor a general regularly varying tail, moments are finite when \\(p<\\alpha\\) and infinite when \\(p>\\alpha\\). At \\(p=\\alpha\\), finiteness depends on the slowly varying factor.\n\nBy contrast, a lognormal distribution has finite moments of every positive order but no finite positive exponential moment. This is a central example of why heavy tails and infinite variance are different concepts.\n\nLaws of large numbers and limit distributions\n\nFor independent, identically distributed observations with finite absolute mean, the law of large numbers still applies: the sample mean converges to the population mean. Heavy tails alone do not invalidate averaging.\n\nIf the variance is also finite and nonzero, the usual independent, identically distributed central limit theorem applies. Nevertheless, convergence to a normal approximation can be slow, and finite samples can remain strongly influenced by rare observations.\n\nWhen variance is infinite, the usual square-root-of-sample-size normal approximation is not generally valid. Under appropriate regular-variation and tail-balance conditions, centered and rescaled sums instead converge to a stable distribution. For indices \\(0<\\alpha<2\\), the scale is typically \\(n^{1/\\alpha}\\) times a slowly varying factor, rather than \\(\\sqrt n\\).\n\nNeither stable convergence nor single-big-jump behavior follows from heavy-tailedness alone; each requires additional assumptions."
    },
    {
      "heading": "Extremes and statistical inference",
      "text": "Heavy tails are central to extreme value theory, which studies unusually large observations, sample maxima, and threshold exceedances. Regularly varying right tails with exponent \\(\\alpha>0\\) belong to the Fréchet domain of attraction: appropriately scaled maxima converge to a Fréchet distribution.\n\nNot all heavy tails have this type of extreme-value limit. Lognormal distributions and Weibull distributions with shape below one are heavy-tailed but belong to the Gumbel domain of attraction. Exponential-moment classification and extreme-value classification therefore answer different questions.\n\nEstimating a power-law tail\n\nFor positive observations with a regularly varying upper tail, one common estimator is the Hill estimator. With ordered observations\n\n\\[X_{(1)}\\le\\cdots\\le X_{(n)},\\]\n\nit estimates \\(\\xi=1/\\alpha\\) by\n\n\\[\\widehat{\\xi}_k = \\frac{1}{k} \\sum_{j=1}^{k} \\log\\left(\\frac{X_{(n-j+1)}}{X_{(n-k)}}\\right).\\]\n\nOnly the largest \\(k\\) observations are used. Choosing \\(k\\) creates a trade-off: too few extremes produce high variability, whereas too many may include observations outside the range where a power-law approximation is credible. Its theoretical justification requires appropriate tail conditions; it is not an estimator for arbitrary heavy-tailed models.\n\nA roughly straight line on a log–log plot of empirical tail probabilities is not sufficient evidence of a power law. Lognormal, truncated, mixed, and other distributions can resemble a power law over a limited range. Model comparison, threshold sensitivity, dependence, and uncertainty in extrapolation all matter.\n\nA strictly truncated power law with a finite upper endpoint is not asymptotically heavy-tailed. A power law with an exponential cutoff is also light-tailed under the exponential-moment definition, despite possibly displaying an extensive power-law-like region."
    },
    {
      "heading": "Development and applications",
      "text": "Heavy-tail modeling has roots in nineteenth-century studies of income distributions, notably Pareto’s work in the 1890s, and in the development of stable laws and limit theory. Twentieth-century work in insurance mathematics, queues, and extreme-value statistics established systematic methods for studying sums, maxima, and rare losses.\n\nMajor applications include:\n\n- Insurance: modeling large claims and aggregate losses, especially where a single claim can dominate the total.\n- Finance: representing return distributions and losses that are poorly captured by normal models. Whether a particular dataset supports a true power-law tail, another heavy tail, or an eventual cutoff is an empirical question.\n- Computer and communication systems: describing file sizes, job sizes, and service times. In some queueing models, higher moments of service times determine whether mean waiting times are finite.\n- Income and wealth: approximating upper-tail distributions, without necessarily describing the entire population distribution.\n- Physical and environmental extremes: modeling large events where tail extrapolation is important, subject to process-specific assumptions and possible physical bounds.\n\nHeavy-tailed modeling does not by itself identify a causal mechanism. Similar marginal tails can arise from multiplicative growth, mixtures, random amplification, or aggregation. Conversely, mechanisms that create approximate heavy-tail behavior over an observed range may still impose an eventual cutoff."
    },
    {
      "heading": "Limitations of empirical identification",
      "text": "No finite dataset can, without assumptions, establish the behavior of a distribution arbitrarily far into its unobserved tail. Heavy- and light-tailed models may fit the observed range similarly while predicting sharply different probabilities for much larger events.\n\nTemporal dependence, changes in the generating process, censoring, and measurement limits further complicate inference. For time series, clustered extremes can make independent-observation calculations misleading. Statistical claims about heavy tails therefore depend not only on the fitted tail shape, but also on the observation process, the range over which the model is intended to apply, and the assumptions supporting extrapolation."
    }
  ],
  "links": [
    "probability-distribution",
    "normal-distribution",
    "random-variable",
    "cumulative-distribution-function",
    "power-law",
    "convolution",
    "statistical-independence",
    "pareto-distribution",
    "students-t-distribution",
    "cauchy-distribution",
    "lognormal-distribution",
    "exponential-distribution",
    "expected-value",
    "variance",
    "law-of-large-numbers",
    "sample-mean",
    "central-limit-theorem",
    "time-series"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}