{
  "id": "normal-distribution",
  "title": "Normal Distribution",
  "lang": "en",
  "source_lang": "en",
  "summary": "A continuous probability distribution defined by its mean and variance, with a symmetric bell-shaped density and a central role in statistical inference.",
  "category": "mathematics",
  "subcategory": "probability-statistics",
  "type": "concept",
  "aliases": [
    "Gaussian distribution",
    "Gaussian law",
    "normal probability distribution"
  ],
  "generated_at": "2026-10-03",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/normal-distribution/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/normal-distribution/",
      "json": "https://aiwiki.page/zh/normal-distribution.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "The normal distribution, also called the Gaussian distribution, is a continuous probability distribution whose density forms a symmetric, bell-shaped curve. It describes a random variable through two parameters: its mean, which determines the center, and its variance, which determines the spread. Normal distributions are fundamental to statistics, both as models for observations and as approximations to the distributions of sample averages and other statistics. (itl.nist.gov)"
    },
    {
      "heading": "Definition and parameters",
      "text": "A random variable \\(X\\) has a normal distribution with mean \\(\\mu\\) and variance \\(\\sigma^2>0\\), written \\(X\\sim N(\\mu,\\sigma^2)\\), if its probability density function is\n\n\\[f(x)=\\frac{1}{\\sigma\\sqrt{2\\pi}} \\exp\\left[-\\frac{(x-\\mu)^2}{2\\sigma^2}\\right], \\qquad -\\infty<x<\\infty.\\]\n\nThe parameter \\(\\mu\\) can be any real number, while \\(\\sigma>0\\) is the standard deviation. Some sources use \\(N(\\mu,\\sigma)\\) instead, so the meaning of the second parameter must be checked. (itl.nist.gov)\n\nThe expected value is \\(\\mu\\), and the variance is \\(\\sigma^2\\). The mean, median, and mode coincide. Increasing \\(\\mu\\) shifts the curve without changing its shape; increasing \\(\\sigma\\) makes it wider and lowers its peak. Its skewness is zero and its kurtosis is three, giving zero excess kurtosis. (itl.nist.gov)\n\nThe total area beneath the density is one. The probability of an interval is the integral of the density over that interval, rather than the density at an individual point. Consequently, a particular exact value has probability zero, although every interval of positive length has positive probability. (itl.nist.gov)"
    },
    {
      "heading": "Standardization and probabilities",
      "text": "The standard normal distribution has mean zero and variance one. If \\(X\\sim N(\\mu,\\sigma^2)\\), then\n\n\\[Z=\\frac{X-\\mu}{\\sigma}\\sim N(0,1).\\]\n\nAn observed standardized value is commonly called a z-score: it expresses distance from the mean in standard-deviation units. Standardization allows probabilities for every normal distribution to be calculated using the same reference distribution. (itl.nist.gov)\n\nThe standard normal cumulative distribution function is\n\n\\[\\Phi(z)=\\frac{1}{\\sqrt{2\\pi}} \\int_{-\\infty}^{z}e^{-t^2/2}\\,dt.\\]\n\nThus,\n\n\\[P(a\\le X\\le b)= \\Phi\\left(\\frac{b-\\mu}{\\sigma}\\right) -\\Phi\\left(\\frac{a-\\mu}{\\sigma}\\right).\\]\n\nThis integral has no elementary antiderivative; numerical methods and probability tables provide its values. Symmetry gives \\(\\Phi(-z)=1-\\Phi(z)\\). (itl.nist.gov)\n\nApproximately 68.27% of probability lies within one standard deviation of the mean, 95.45% within two, and 99.73% within three. These proportions are often rounded to the 68–95–99.7 rule. They describe the theoretical distribution, not guaranteed percentages in every finite sample. (itl.nist.gov)"
    },
    {
      "heading": "Sums and the central limit theorem",
      "text": "Normal distributions are closed under sums of independent normal variables. If \\(X\\sim N(\\mu_X,\\sigma_X^2)\\) and \\(Y\\sim N(\\mu_Y,\\sigma_Y^2)\\) are independent, then\n\n\\[X+Y\\sim N(\\mu_X+\\mu_Y,\\sigma_X^2+\\sigma_Y^2).\\]\n\nMore generally, a linear combination of independent normal variables is normal, provided its variance is positive; a zero-variance combination is constant. (new.statlect.com)\n\nThe central limit theorem explains why normal approximations arise even from nonnormal populations. For independent, identically distributed variables with finite mean \\(\\mu\\) and finite positive variance \\(\\sigma^2\\), the standardized sample mean converges in distribution to \\(N(0,1)\\):\n\n\\[\\frac{\\sqrt n(\\overline X_n-\\mu)}{\\sigma} \\xrightarrow{d}N(0,1).\\]\n\nAccordingly, sufficiently large sample means can often be approximated by \\(N(\\mu,\\sigma^2/n)\\). The theorem concerns averages, not a transformation of the original observations into normally distributed data. The required sample size depends on the underlying distribution; there is no universal threshold guaranteeing a satisfactory approximation. (mathworks.com)"
    },
    {
      "heading": "Estimation and statistical inference",
      "text": "For independent observations \\(x_1,\\ldots,x_n\\) from a normal population, maximum likelihood estimation gives\n\n\\[\\widehat\\mu=\\overline x,\\qquad \\widehat{\\sigma}^{\\,2}= \\frac1n\\sum_{i=1}^{n}(x_i-\\overline x)^2.\\]\n\nThe variance estimate uses denominator \\(n\\) and is biased downward. Replacing \\(n\\) with \\(n-1\\) gives the usual unbiased sample variance. The distinction separates likelihood maximization from unbiased estimation. (mail.statlect.com)\n\nNormal distributions underpin many confidence intervals and procedures in statistical hypothesis testing. When independent observations are normal, their sample mean is exactly normal at every sample size. If population variance is unknown, inference about the mean commonly uses Student’s t-distribution, accounting for uncertainty in estimating the standard deviation. (itl.nist.gov)\n\nIn linear regression, normality is commonly an assumption about errors conditional on predictors, not about every predictor or the response considered separately. Normal probability plots of fitted residuals provide a graphical diagnostic: approximate linearity supports a normal error model, while systematic departures indicate a mismatch. (itl.nist.gov)"
    },
    {
      "heading": "Multivariate extension and historical development",
      "text": "The multivariate normal distribution extends the model to random vectors. A mean vector specifies the center, and a covariance matrix specifies variances and dependence. Every linear combination of a jointly normal vector’s components is normal or constant. However, individually normal components do not necessarily form a jointly normal vector. (itl.nist.gov)\n\nHistorically, Abraham de Moivre derived a normal approximation to the binomial distribution in 1733. Pierre-Simon Laplace developed its role in probability and error theory. The name Gaussian reflects the influential treatment of observational errors by Carl Friedrich Gauss, notably in his 1809 work on celestial motion. (mathshistory.st-andrews.ac.uk)"
    }
  ],
  "links": [
    "probability-distribution",
    "random-variable",
    "statistics",
    "probability-density-function",
    "real-number",
    "standard-deviation",
    "expected-value",
    "variance",
    "probability",
    "integral",
    "z-score",
    "cumulative-distribution-function",
    "linear-combination",
    "central-limit-theorem",
    "maximum-likelihood-estimation",
    "confidence-interval",
    "statistical-hypothesis-testing",
    "students-t-distribution",
    "linear-regression",
    "multivariate-normal-distribution",
    "covariance-matrix",
    "pierre-simon-laplace",
    "carl-friedrich-gauss"
  ],
  "sources": [
    {
      "title": "itl.nist.gov/div898/handbook/eda/section3/eda3661.htm",
      "url": "https://www.itl.nist.gov/div898/handbook/eda/section3/eda3661.htm"
    },
    {
      "title": "itl.nist.gov/div898/handbook/pmc/section5/pmc51.htm",
      "url": "https://www.itl.nist.gov/div898/handbook/pmc/section5/pmc51.htm"
    },
    {
      "title": "new.statlect.com/probability-distributions/normal-distribution-linear-combinati…",
      "url": "https://new.statlect.com/probability-distributions/normal-distribution-linear-combinations"
    },
    {
      "title": "mathworks.com/help/stats/normal-distribution.html",
      "url": "https://www.mathworks.com/help/stats/normal-distribution.html"
    },
    {
      "title": "mail.statlect.com/fundamentals-of-statistics/normal-distribution-maximum-likeli…",
      "url": "https://mail.statlect.com/fundamentals-of-statistics/normal-distribution-maximum-likelihood"
    },
    {
      "title": "itl.nist.gov/div898/handbook/pmc/section5/pmc542.htm",
      "url": "https://www.itl.nist.gov/div898/handbook/pmc/section5/pmc542.htm"
    },
    {
      "title": "mathshistory.st-andrews.ac.uk/Biographies/De_Moivre/",
      "url": "https://mathshistory.st-andrews.ac.uk/Biographies/De_Moivre/"
    }
  ],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}