The Wiener–Khinchin theorem establishes the relationship between the autocorrelation of a stationary random process and its power spectral density. In its familiar form, these quantities are a Fourier transform pair: autocorrelation describes how values separated in time are related, while the power spectrum describes how the process’s mean-square amplitude is distributed across frequencies. The general theorem uses a nonnegative spectral measure rather than assuming that a spectral density exists. It is a foundational result in harmonic analysis, probability, and signal processing.
Continuous-time formulation
Let , for , be a complex-valued stochastic process with finite second moments. Suppose it is wide-sense stationary: its mean is constant, and its autocorrelation depends only on the time difference. Using the convention
the bar denotes complex conjugation and denotes expectation. For a real-valued process, the conjugation can be omitted.
If is absolutely integrable, its power spectral density is
The inverse relationship is
under the usual regularity conditions for Fourier inversion. In particular, for a mean-square continuous stationary process with absolutely integrable autocorrelation, these formulas hold at every lag.
Here is frequency in cycles per unit time. With angular frequency , a common alternative convention is
The factors of therefore depend on the frequency variable and transform convention.
General spectral-measure formulation
Absolute integrability is a useful sufficient condition, but it is not necessary for a stationary process to have a spectrum. Periodic components, for example, produce spectral lines that cannot be represented by an ordinary density function.
For a wide-sense stationary process whose autocorrelation is continuous at zero, there exists a unique finite nonnegative measure on the frequency axis such that
The measure is the spectral measure. Its total mass is
This formulation is closely connected to Bochner’s theorem, which characterizes continuous positive-definite functions as Fourier transforms of finite nonnegative measures.
If is absolutely continuous with respect to Lebesgue measure, then it has a density:
Other possibilities include point masses, representing spectral lines, and singular continuous components. A general spectrum can contain all three types. Consequently, the statement that “the spectrum is the Fourier transform of the autocorrelation” may require a measure-theoretic or distributional interpretation.
Continuity at zero is an important hypothesis in this continuous-time representation. Finite second moments and wide-sense stationarity alone do not provide every regularity property required by the usual spectral theorem on the real frequency axis.
Autocorrelation and autocovariance
Autocorrelation is not necessarily the same as autocovariance. If the constant mean is , then
and
Accordingly, their spectral measures satisfy
where is a unit point mass at zero frequency. A nonzero mean therefore contributes a zero-frequency, or DC, spectral line.
The autocorrelation spectrum has total mass , whereas the autocovariance spectrum has total mass equal to the variance. Some treatments define “power spectrum” using the centered process, so the convention must be specified.
Neither quantity should be confused with normalized autocorrelation, which divides the autocovariance by its value at zero.
Why the spectrum is nonnegative
Autocorrelation is positive definite. For arbitrary times and complex coefficients ,
This property is stronger than the symmetry relation
It is the mathematical reason the spectral measure is nonnegative. When a spectral density exists, it is nonnegative almost everywhere.
For real-valued processes, the autocorrelation is real and even, and the power spectrum is symmetric about zero frequency. For complex-valued processes, the spectrum is still real and nonnegative, but need not be even.
Connection with finite-time Fourier transforms
A stationary process generally does not have finite total energy over the entire time axis. Its ordinary Fourier transform need not exist as an integrable function, so its power spectrum cannot generally be defined by simply squaring an infinite-duration Fourier transform.
Instead, consider the finite observation
The expected normalized squared magnitude satisfies
The triangular factor comes from the overlap of the observation interval with a shifted copy of itself. If is absolutely integrable, the dominated convergence theorem gives
This identity connects the autocorrelation formulation with the interpretation of the spectrum as mean power per unit frequency. The expectation matters: it does not assert that the squared Fourier transform of a single realization converges pointwise to the spectral density.
Discrete-time version
For a wide-sense stationary sequence , define
If the autocorrelation sequence is absolutely summable, its spectral density is
with inverse
The spectrum is -periodic in angular frequency, reflecting the indistinguishability of frequencies differing by an integer multiple of radians per sample.
More generally, every positive-definite autocorrelation sequence has a finite nonnegative spectral measure on the frequency circle. This is the discrete-time counterpart associated with Herglotz’s theorem.
For finite data, discrete Fourier transforms and the fast Fourier transform provide efficient calculations linking sample correlations and squared Fourier magnitudes. Circular versus linear correlation, zero-padding, and normalization must be distinguished when applying these identities computationally.
Examples
Exponentially decaying autocorrelation
Suppose a zero-mean process has
Its power spectral density is
This is a Lorentzian spectrum. Faster correlation decay, corresponding to larger , produces a broader spectrum. Its integral is , as required by the value of the autocorrelation at zero.
Sinusoid with random phase
Let
where is constant, , and is uniformly distributed on . Then
The spectral measure is
The two spectral lines carry total power . Because the autocorrelation does not decay, the ordinary absolutely integrable Fourier-transform formulation is insufficient; the spectral-measure formulation applies directly.
Discrete white noise
For a zero-mean uncorrelated sequence with variance ,
so
Thus discrete-time white noise has a flat spectrum. Continuous-time ideal white noise requires generalized random processes: a nonzero constant spectral density over the entire real frequency axis would have infinite total power and cannot describe an ordinary finite-variance process.
Applications and limitations
The theorem connects two complementary methods of analyzing time series: measuring dependence across time lags and measuring power across frequencies. It underlies spectral estimation in communications, acoustics, vibration analysis, and spectroscopy.
For a stationary input passed through a suitable stable linear time-invariant filter with frequency response , the output spectrum obeys
This follows by combining the theorem with the convolution relationship between the filter and the input.
Several distinctions limit how the theorem can be applied:
- Stationarity versus nonstationarity. A general nonstationary process has a correlation depending on two separate times. A single lag-dependent autocorrelation and its spectrum do not capture that full structure.
- Ensemble averages versus time averages. Stationarity alone does not justify replacing expectations by averages along one observed record. Such replacements require appropriate ergodic assumptions.
- Exact identities versus statistical estimates. Finite observation windows blur spectral features. A raw periodogram is generally not a consistent pointwise estimator of a continuous spectral density without suitable averaging or smoothing.
- Second-order information versus complete probability laws. Autocorrelation and power spectra describe second moments, not every aspect of a process. Different processes can share the same spectrum. For a Gaussian process, the mean and covariance determine all finite-dimensional distributions.
- Power signals versus energy signals. For a finite-energy deterministic signal, a related autocorrelation identity gives an energy spectrum . That result uses an integral autocorrelation rather than the stationary ensemble correlation and its power-per-unit-time normalization.
Historical development
The theorem is named after Norbert Wiener and Aleksandr Khinchin, whose surname is also transliterated as Khintchine. Wiener developed a generalized harmonic-analysis treatment in 1930, and Khinchin presented a stationary-process formulation in 1934. The name Wiener–Khinchin–Einstein theorem also recognizes Albert Einstein’s earlier work connecting fluctuations and spectral descriptions.
Modern formulations place the result within the broader theory of positive-definite functions and spectral representations of stationary processes.