{
  "id": "wiener-khinchin-theorem",
  "title": "Wiener–Khinchin Theorem",
  "lang": "en",
  "source_lang": "en",
  "summary": "The Wiener–Khinchin theorem relates a stationary process’s autocorrelation to its power spectrum through the Fourier transform, with a spectral-measure formulation covering both continuous spectra and spectral lines.",
  "category": "mathematics",
  "subcategory": "probability-statistics",
  "type": "concept",
  "aliases": [
    "Wiener–Khintchine theorem",
    "Wiener–Khinchin–Einstein theorem",
    "Autocorrelation theorem"
  ],
  "generated_at": "2026-11-05",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/wiener-khinchin-theorem/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/wiener-khinchin-theorem/",
      "json": "https://aiwiki.page/zh/wiener-khinchin-theorem.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "The Wiener–Khinchin theorem establishes the relationship between the autocorrelation of a stationary random process and its power spectral density. In its familiar form, these quantities are a Fourier transform pair: autocorrelation describes how values separated in time are related, while the power spectrum describes how the process’s mean-square amplitude is distributed across frequencies. The general theorem uses a nonnegative spectral measure rather than assuming that a spectral density exists. It is a foundational result in harmonic analysis, probability, and signal processing."
    },
    {
      "heading": "Continuous-time formulation",
      "text": "Let \\(X(t)\\), for \\(t\\in\\mathbb R\\), be a complex-valued stochastic process with finite second moments. Suppose it is wide-sense stationary: its mean is constant, and its autocorrelation depends only on the time difference. Using the convention\n\n\\[R_X(\\tau) = \\mathbb E\\!\\left[X(t+\\tau)\\overline{X(t)}\\right],\\]\n\nthe bar denotes complex conjugation and \\(\\mathbb E\\) denotes expectation. For a real-valued process, the conjugation can be omitted.\n\nIf \\(R_X\\) is absolutely integrable, its power spectral density is\n\n\\[S_X(f) = \\int_{-\\infty}^{\\infty} R_X(\\tau)e^{-i2\\pi f\\tau}\\,d\\tau.\\]\n\nThe inverse relationship is\n\n\\[R_X(\\tau) = \\int_{-\\infty}^{\\infty} S_X(f)e^{i2\\pi f\\tau}\\,df,\\]\n\nunder the usual regularity conditions for Fourier inversion. In particular, for a mean-square continuous stationary process with absolutely integrable autocorrelation, these formulas hold at every lag.\n\nHere \\(f\\) is frequency in cycles per unit time. With angular frequency \\(\\omega=2\\pi f\\), a common alternative convention is\n\n\\[\\Phi_X(\\omega) = \\int_{-\\infty}^{\\infty} R_X(\\tau)e^{-i\\omega\\tau}\\,d\\tau, \\qquad R_X(\\tau) = \\frac{1}{2\\pi} \\int_{-\\infty}^{\\infty} \\Phi_X(\\omega)e^{i\\omega\\tau}\\,d\\omega.\\]\n\nThe factors of \\(2\\pi\\) therefore depend on the frequency variable and transform convention."
    },
    {
      "heading": "General spectral-measure formulation",
      "text": "Absolute integrability is a useful sufficient condition, but it is not necessary for a stationary process to have a spectrum. Periodic components, for example, produce spectral lines that cannot be represented by an ordinary density function.\n\nFor a wide-sense stationary process whose autocorrelation is continuous at zero, there exists a unique finite nonnegative measure \\(\\mu_X\\) on the frequency axis such that\n\n\\[R_X(\\tau) = \\int_{\\mathbb R} e^{i2\\pi f\\tau}\\,\\mu_X(df).\\]\n\nThe measure \\(\\mu_X\\) is the spectral measure. Its total mass is\n\n\\[\\mu_X(\\mathbb R) = R_X(0) = \\mathbb E|X(t)|^2.\\]\n\nThis formulation is closely connected to Bochner’s theorem, which characterizes continuous positive-definite functions as Fourier transforms of finite nonnegative measures.\n\nIf \\(\\mu_X\\) is absolutely continuous with respect to Lebesgue measure, then it has a density:\n\n\\[\\mu_X(df)=S_X(f)\\,df.\\]\n\nOther possibilities include point masses, representing spectral lines, and singular continuous components. A general spectrum can contain all three types. Consequently, the statement that “the spectrum is the Fourier transform of the autocorrelation” may require a measure-theoretic or distributional interpretation.\n\nContinuity at zero is an important hypothesis in this continuous-time representation. Finite second moments and wide-sense stationarity alone do not provide every regularity property required by the usual spectral theorem on the real frequency axis."
    },
    {
      "heading": "Autocorrelation and autocovariance",
      "text": "Autocorrelation is not necessarily the same as autocovariance. If the constant mean is \\(m=\\mathbb E[X(t)]\\), then\n\n\\[C_X(\\tau) = \\mathbb E\\!\\left[ (X(t+\\tau)-m)\\overline{(X(t)-m)} \\right],\\]\n\nand\n\n\\[R_X(\\tau)=C_X(\\tau)+|m|^2.\\]\n\nAccordingly, their spectral measures satisfy\n\n\\[\\mu_R=\\mu_C+|m|^2\\delta_0,\\]\n\nwhere \\(\\delta_0\\) is a unit point mass at zero frequency. A nonzero mean therefore contributes a zero-frequency, or DC, spectral line.\n\nThe autocorrelation spectrum has total mass \\(\\mathbb E|X|^2\\), whereas the autocovariance spectrum has total mass equal to the variance. Some treatments define “power spectrum” using the centered process, so the convention must be specified.\n\nNeither quantity should be confused with normalized autocorrelation, which divides the autocovariance by its value at zero."
    },
    {
      "heading": "Why the spectrum is nonnegative",
      "text": "Autocorrelation is positive definite. For arbitrary times \\(t_1,\\ldots,t_n\\) and complex coefficients \\(c_1,\\ldots,c_n\\),\n\n\\[\\sum_{j,k=1}^{n} c_j\\overline{c_k}R_X(t_j-t_k) = \\mathbb E\\left| \\sum_{j=1}^{n}c_jX(t_j) \\right|^2 \\geq 0.\\]\n\nThis property is stronger than the symmetry relation\n\n\\[R_X(-\\tau)=\\overline{R_X(\\tau)}.\\]\n\nIt is the mathematical reason the spectral measure is nonnegative. When a spectral density exists, it is nonnegative almost everywhere.\n\nFor real-valued processes, the autocorrelation is real and even, and the power spectrum is symmetric about zero frequency. For complex-valued processes, the spectrum is still real and nonnegative, but need not be even."
    },
    {
      "heading": "Connection with finite-time Fourier transforms",
      "text": "A stationary process generally does not have finite total energy over the entire time axis. Its ordinary Fourier transform need not exist as an integrable function, so its power spectrum cannot generally be defined by simply squaring an infinite-duration Fourier transform.\n\nInstead, consider the finite observation\n\n\\[X_T(f) = \\int_{-T/2}^{T/2} X(t)e^{-i2\\pi ft}\\,dt.\\]\n\nThe expected normalized squared magnitude satisfies\n\n\\[\\frac{1}{T}\\mathbb E|X_T(f)|^2 = \\int_{-T}^{T} \\left(1-\\frac{|\\tau|}{T}\\right) R_X(\\tau)e^{-i2\\pi f\\tau}\\,d\\tau.\\]\n\nThe triangular factor comes from the overlap of the observation interval with a shifted copy of itself. If \\(R_X\\) is absolutely integrable, the dominated convergence theorem gives\n\n\\[S_X(f) = \\lim_{T\\to\\infty} \\frac{1}{T}\\mathbb E|X_T(f)|^2.\\]\n\nThis identity connects the autocorrelation formulation with the interpretation of the spectrum as mean power per unit frequency. The expectation matters: it does not assert that the squared Fourier transform of a single realization converges pointwise to the spectral density."
    },
    {
      "heading": "Discrete-time version",
      "text": "For a wide-sense stationary sequence \\(X_n\\), define\n\n\\[R_X[k] = \\mathbb E[X_{n+k}\\overline{X_n}].\\]\n\nIf the autocorrelation sequence is absolutely summable, its spectral density is\n\n\\[S_X(\\omega) = \\sum_{k=-\\infty}^{\\infty} R_X[k]e^{-i\\omega k},\\]\n\nwith inverse\n\n\\[R_X[k] = \\frac{1}{2\\pi} \\int_{-\\pi}^{\\pi} S_X(\\omega)e^{i\\omega k}\\,d\\omega.\\]\n\nThe spectrum is \\(2\\pi\\)-periodic in angular frequency, reflecting the indistinguishability of frequencies differing by an integer multiple of \\(2\\pi\\) radians per sample.\n\nMore generally, every positive-definite autocorrelation sequence has a finite nonnegative spectral measure on the frequency circle. This is the discrete-time counterpart associated with Herglotz’s theorem.\n\nFor finite data, discrete Fourier transforms and the fast Fourier transform provide efficient calculations linking sample correlations and squared Fourier magnitudes. Circular versus linear correlation, zero-padding, and normalization must be distinguished when applying these identities computationally."
    },
    {
      "heading": "Examples",
      "text": "Exponentially decaying autocorrelation\n\nSuppose a zero-mean process has\n\n\\[R_X(\\tau)=\\sigma^2e^{-a|\\tau|}, \\qquad a>0.\\]\n\nIts power spectral density is\n\n\\[S_X(f) = \\frac{2a\\sigma^2}{a^2+(2\\pi f)^2}.\\]\n\nThis is a Lorentzian spectrum. Faster correlation decay, corresponding to larger \\(a\\), produces a broader spectrum. Its integral is \\(\\sigma^2\\), as required by the value of the autocorrelation at zero.\n\nSinusoid with random phase\n\nLet\n\n\\[X(t)=A\\cos(2\\pi f_0t+\\Theta),\\]\n\nwhere \\(A\\) is constant, \\(f_0>0\\), and \\(\\Theta\\) is uniformly distributed on \\([0,2\\pi)\\). Then\n\n\\[R_X(\\tau)=\\frac{A^2}{2}\\cos(2\\pi f_0\\tau).\\]\n\nThe spectral measure is\n\n\\[\\mu_X = \\frac{A^2}{4} \\left(\\delta_{f_0}+\\delta_{-f_0}\\right).\\]\n\nThe two spectral lines carry total power \\(A^2/2\\). Because the autocorrelation does not decay, the ordinary absolutely integrable Fourier-transform formulation is insufficient; the spectral-measure formulation applies directly.\n\nDiscrete white noise\n\nFor a zero-mean uncorrelated sequence with variance \\(\\sigma^2\\),\n\n\\[R_X[k] = \\begin{cases} \\sigma^2,&k=0,\\\\ 0,&k\\ne0, \\end{cases}\\]\n\nso\n\n\\[S_X(\\omega)=\\sigma^2.\\]\n\nThus discrete-time white noise has a flat spectrum. Continuous-time ideal white noise requires generalized random processes: a nonzero constant spectral density over the entire real frequency axis would have infinite total power and cannot describe an ordinary finite-variance process."
    },
    {
      "heading": "Applications and limitations",
      "text": "The theorem connects two complementary methods of analyzing time series: measuring dependence across time lags and measuring power across frequencies. It underlies spectral estimation in communications, acoustics, vibration analysis, and spectroscopy.\n\nFor a stationary input passed through a suitable stable linear time-invariant filter with frequency response \\(H(f)\\), the output spectrum obeys\n\n\\[S_Y(f)=|H(f)|^2S_X(f).\\]\n\nThis follows by combining the theorem with the convolution relationship between the filter and the input.\n\nSeveral distinctions limit how the theorem can be applied:\n\n- Stationarity versus nonstationarity. A general nonstationary process has a correlation depending on two separate times. A single lag-dependent autocorrelation and its spectrum do not capture that full structure.\n- Ensemble averages versus time averages. Stationarity alone does not justify replacing expectations by averages along one observed record. Such replacements require appropriate ergodic assumptions.\n- Exact identities versus statistical estimates. Finite observation windows blur spectral features. A raw periodogram is generally not a consistent pointwise estimator of a continuous spectral density without suitable averaging or smoothing.\n- Second-order information versus complete probability laws. Autocorrelation and power spectra describe second moments, not every aspect of a process. Different processes can share the same spectrum. For a Gaussian process, the mean and covariance determine all finite-dimensional distributions.\n- Power signals versus energy signals. For a finite-energy deterministic signal, a related autocorrelation identity gives an energy spectrum \\(|\\widehat{x}(f)|^2\\). That result uses an integral autocorrelation rather than the stationary ensemble correlation and its power-per-unit-time normalization."
    },
    {
      "heading": "Historical development",
      "text": "The theorem is named after Norbert Wiener and Aleksandr Khinchin, whose surname is also transliterated as Khintchine. Wiener developed a generalized harmonic-analysis treatment in 1930, and Khinchin presented a stationary-process formulation in 1934. The name Wiener–Khinchin–Einstein theorem also recognizes Albert Einstein’s earlier work connecting fluctuations and spectral descriptions.\n\nModern formulations place the result within the broader theory of positive-definite functions and spectral representations of stationary processes."
    }
  ],
  "links": [
    "autocorrelation",
    "stationary-process",
    "fourier-transform",
    "harmonic-analysis",
    "stochastic-process",
    "expected-value",
    "lebesgue-measure",
    "covariance",
    "variance",
    "dominated-convergence-theorem",
    "discrete-fourier-transform",
    "fast-fourier-transform",
    "time-series",
    "spectroscopy",
    "convolution",
    "ergodicity",
    "gaussian-process",
    "norbert-wiener"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}