aiwiki.page
English
Mathematics / Analysis & Calculus / spectral-density

Spectral Density

Spectral density describes how a signal’s energy or a stationary process’s variance is distributed across frequencies.

38 keywords1 linked from6 not yet writtenWritten by AI
Time SeriesFourier Transfor…Probability Dens…Stationary Proce…Expected valueWiener–Khinchin…Measure TheoryLebesgue MeasureSpectral D…

Spectral density is a mathematical description of how a quantity—most commonly signal energy, mean-square amplitude, or variance—is distributed over frequency. In time-series analysis and signal processing, the term usually means power spectral density: a nonnegative function whose integral over a frequency band gives that band’s contribution to the total mean-square value. For a centered stationary random process, the integral over all frequencies equals its variance. Spectral density therefore connects fluctuations observed in time with oscillatory structure expressed in frequency.

The central relationship is between spectral density and the Fourier transform of an autocovariance or autocorrelation function. This relationship makes spectral methods useful for detecting periodic components, characterizing noise, analyzing linear systems, and estimating the scales on which a process varies. A spectrum can distinguish slowly varying fluctuations from rapid ones even when the corresponding time records have similar overall variability. Its interpretation nevertheless depends on stationarity, sampling, normalization, and the statistical uncertainty introduced by observing only a finite record.

More generally, spectral distributions need not possess ordinary density functions: periodic components produce discrete spectral lines, and other processes can have singular spectral measures. Related uses of “spectral density” occur in spatial statistics, statistical physics, and operator theory, where the spectral variable may be a wave number, energy, or eigenvalue rather than temporal frequency.

Frequency conventions, normalization, and units

A spectral density is defined relative to a frequency coordinate and an integration convention. For a continuous-time process, frequency ff, measured in cycles per unit time, and angular frequency ω\omega, measured in radians per unit time, satisfy ω=2πf\omega=2\pi f. A common Fourier convention for an autocovariance function C(τ)C(\tau) is

Sf(f)=∫−∞∞C(τ)e−i2πfτ dτ,C(τ)=∫−∞∞Sf(f)ei2πfτ df.S_f(f)=\int_{-\infty}^{\infty}C(\tau)e^{-i2\pi f\tau}\,d\tau, \qquad C(\tau)=\int_{-\infty}^{\infty}S_f(f)e^{i2\pi f\tau}\,df.

Under this convention, C(0)=∫Sf(f) dfC(0)=\int S_f(f)\,df. The area under the density, rather than its height at a single frequency, is the physically relevant contribution to variance.

Two angular-frequency conventions are widespread. One defines

Sω(ω)=∫−∞∞C(τ)e−iωτ dτ,C(τ)=12π∫−∞∞Sω(ω)eiωτ dω.S_\omega(\omega)=\int_{-\infty}^{\infty}C(\tau)e^{-i\omega\tau}\,d\tau, \qquad C(\tau)=\frac{1}{2\pi}\int_{-\infty}^{\infty} S_\omega(\omega)e^{i\omega\tau}\,d\omega.

Here Sω(ω)=Sf(ω/2π)S_\omega(\omega)=S_f(\omega/2\pi), and the integration measure is dω/(2π)d\omega/(2\pi). Another convention defines a density directly with respect to dωd\omega, namely pω(ω)=Sf(ω/2π)/(2π)p_\omega(\omega)=S_f(\omega/2\pi)/(2\pi). These conventions describe the same variance distribution, but their numerical densities differ by 2π2\pi. A spectral formula is therefore incomplete unless its transform and integration conventions are specified.

For a real-valued process, the two-sided spectrum is even: Sf(−f)=Sf(f)S_f(-f)=S_f(f). A one-sided spectrum places all continuous spectral power at nonnegative frequencies:

Sf(1)(f)=2Sf(f),f>0.S_f^{(1)}(f)=2S_f(f),\qquad f>0.

Its integral over positive frequencies equals that of the two-sided spectrum over the whole line. Zero frequency and, in sampled data, the Nyquist frequency require separate treatment when they carry discrete mass or correspond to unpaired transform bins. Doubling every bin indiscriminately gives an incorrect normalization.

If a signal is measured in volts and time in seconds, its power spectral density has units V2/Hz\mathrm{V}^2/\mathrm{Hz}. The term “power” here often means mean-square amplitude, not electrical power in watts. Conversion to dissipated electrical power requires a circuit model, such as division by a resistance. The square root of a power spectral density is an amplitude spectral density, with units V/Hz\mathrm{V}/\sqrt{\mathrm{Hz}}. Its integral does not give a root-mean-square amplitude; the density must first be squared and integrated.

Unlike a probability density, a spectral density need not integrate to one. Its integral may equal any finite variance. Dividing a centered process’s spectrum by its variance produces a normalized spectral distribution, but this is an additional normalization rather than part of the definition.

Stationary processes and the spectral representation

The probabilistic foundation begins with a second-order stationary process X(t)X(t). Its mean μ\mu is constant, its second moment is finite, and its covariance depends only on the time difference:

C(τ)=E ⁣[(X(t+τ)−μ)(X(t)−μ)‾].C(\tau)= \mathbb{E}\!\left[(X(t+\tau)-\mu)\overline{(X(t)-\mu)}\right].

The overbar denotes complex conjugation. The expectation averages over realizations of the process, rather than over an observed time record. The distinction matters because stationarity alone does not guarantee that time averages converge to the corresponding ensemble quantities.

The Wiener–Khinchin theorem identifies the spectrum with the Fourier transform of this covariance, under conditions permitting an ordinary transform. If CC is absolutely integrable, the formula

S(f)=∫−∞∞C(τ)e−i2πfτ dτS(f)=\int_{-\infty}^{\infty}C(\tau)e^{-i2\pi f\tau}\,d\tau

gives a continuous, nonnegative spectral density. Absolute integrability is sufficient, not necessary, for a density to exist. Nonnegativity follows from the positive-definite character of covariance: every finite linear combination of process values has a nonnegative variance. Thus covariance functions cannot be chosen arbitrarily.

The more general statement uses measure theory. For a mean-square continuous stationary process, there is a finite nonnegative spectral measure FF such that

C(τ)=∫Rei2πfτ dF(f).C(\tau)=\int_{\mathbb R}e^{i2\pi f\tau}\,dF(f).

An ordinary spectral density exists when FF is absolutely continuous with respect to Lebesgue measure, in which case dF(f)=S(f) dfdF(f)=S(f)\,df. A spectral measure can instead contain atoms, which represent spectral lines, or a singular continuous component. Treating every spectrum as a smooth function excludes these valid possibilities.

For a discrete-time process XnX_n, frequency is periodic because ei(ω+2π)n=eiωne^{i(\omega+2\pi)n}=e^{i\omega n}. A standard convention is

C[k]=12π∫−ππs(ω)eiωk dω,s(ω)=∑k=−∞∞C[k]e−iωk,C[k]=\frac{1}{2\pi}\int_{-\pi}^{\pi} s(\omega)e^{i\omega k}\,d\omega, \qquad s(\omega)=\sum_{k=-\infty}^{\infty}C[k]e^{-i\omega k},

when the series is appropriately defined. Consequently, C[0]=(2π)−1∫−ππs(ω) dωC[0]=(2\pi)^{-1}\int_{-\pi}^{\pi}s(\omega)\,d\omega. Frequencies outside one interval of length 2π2\pi do not provide additional information.

The spectral representation expresses a centered process as an integral of complex oscillations with orthogonal random increments:

X(t)−μ=∫Rei2πft dZ(f).X(t)-\mu=\int_{\mathbb R}e^{i2\pi ft}\,dZ(f).

The expected squared magnitude of an increment is determined by the corresponding spectral mass. Orthogonal increments are uncorrelated; they need not be independent. For a Gaussian process, however, the mean and covariance determine all finite-dimensional distributions. Its spectrum, together with its mean, therefore supplies a complete second-order and distributional description, whereas a non-Gaussian process can have important higher-order structure invisible to its spectrum.

Energy spectra, power spectra, and spectral lines

For a deterministic signal x(t)x(t) with finite energy,

E=∫−∞∞∣x(t)∣2 dt<∞,E=\int_{-\infty}^{\infty}|x(t)|^2\,dt<\infty,

its Fourier transform X(f)X(f) defines an energy spectral density

Ψx(f)=∣X(f)∣2.\Psi_x(f)=|X(f)|^2.

Parseval’s identity gives E=∫Ψx(f) dfE=\int\Psi_x(f)\,df. If xx is measured in volts, this density has units V2s2\mathrm{V}^2\mathrm{s}^2, equivalently V2s/Hz\mathrm{V}^2\mathrm{s}/\mathrm{Hz}, because its frequency integral gives integrated squared voltage rather than mean-square voltage. Calling this quantity a power spectral density obscures the distinction between finite energy and sustained average power.

A persistent sinusoid has infinite energy over the whole real line but finite time-average power. Its ordinary Fourier transform is not a square-integrable function, so simply squaring that transform is not a valid definition of a power spectrum. Instead, one can examine a finite observation:

XT(f)=∫−T/2T/2x(t)e−i2πft dt,X_T(f)=\int_{-T/2}^{T/2}x(t)e^{-i2\pi ft}\,dt,

and study the measures with densities T−1∣XT(f)∣2T^{-1}|X_T(f)|^2. For a stationary random process, the corresponding expected quantities are related to the spectral measure. The limiting operation may need to be understood weakly, through integrals against test functions, rather than as pointwise convergence of ordinary functions.

For example, let

X(t)=Acos⁡(2πf0t+Φ),X(t)=A\cos(2\pi f_0t+\Phi),

where Φ\Phi is uniform on [0,2π)[0,2\pi). This process has zero mean and covariance C(τ)=A2cos⁡(2πf0τ)/2C(\tau)=A^2\cos(2\pi f_0\tau)/2. Its two-sided spectrum is

S(f)=A24[δ(f−f0)+δ(f+f0)],S(f)=\frac{A^2}{4} \left[\delta(f-f_0)+\delta(f+f_0)\right],

where δ\delta is the Dirac delta distribution. Each line has mass A2/4A^2/4, and the total variance is A2/2A^2/2. A line’s coefficient is an integrated spectral mass, not the finite height of a density peak.

A nonzero mean creates a related distinction. If the spectrum is defined from the uncentered autocorrelation R(τ)=E[X(t+τ)X(t)‾]R(\tau)=\mathbb E[X(t+\tau)\overline{X(t)}], then

R(τ)=C(τ)+∣μ∣2.R(\tau)=C(\tau)+|\mu|^2.

Its spectral measure therefore contains an additional atom of mass ∣μ∣2|\mu|^2 at zero frequency. The covariance spectrum excludes this constant component and integrates to variance; the autocorrelation spectrum includes it and integrates to the second moment.

For a periodic signal with Fourier-series coefficients ckc_k and fundamental frequency f0f_0, the power spectrum consists of lines with masses ∣ck∣2|c_k|^2 at kf0kf_0. Spectral magnitudes retain component strengths but discard their relative phases. Different waveforms can consequently share the same power spectrum, just as different random processes can share the same covariance.

Characteristic spectra and stochastic models

White noise provides the reference case of a flat spectrum. A discrete-time zero-mean sequence with covariance C[k]=σ2C[k]=\sigma^2 for k=0k=0 and zero otherwise has s(ω)=σ2s(\omega)=\sigma^2 under the angular-frequency convention above. Every interval of equal frequency width contributes equally to variance. Whiteness is a second-order property: it specifies lack of correlation, not independence or a Gaussian distribution. Independent identically distributed variables with finite variance are white after centering, but the converse need not hold.

Ideal continuous-time white noise requires a generalized-process interpretation. Its covariance is proportional to a delta distribution and its spectral density is constant over the entire real line. Integrating that constant gives infinite variance, so it cannot describe ordinary pointwise random variables with finite variance. Physical noise is approximately white only over a bounded frequency range. Filtering the idealization through a system with a square-integrable frequency response can nevertheless produce a well-defined finite-variance output.

An elementary colored-noise model is the first-order autoregressive process

Xn=aXn−1+εn,∣a∣<1,X_n=aX_{n-1}+\varepsilon_n,\qquad |a|<1,

where the innovations are white with variance σε2\sigma_\varepsilon^2. Its stationary covariance and spectrum are

C[k]=σε21−a2a∣k∣,s(ω)=σε21+a2−2acos⁡ω.C[k]=\frac{\sigma_\varepsilon^2}{1-a^2}a^{|k|}, \qquad s(\omega)= \frac{\sigma_\varepsilon^2}{1+a^2-2a\cos\omega}.

Positive aa concentrates power near zero frequency and produces slowly varying records. Negative aa concentrates power near π\pi, producing alternating behavior. As aa approaches either stationarity boundary, the spectral peak becomes increasingly sharp.

A continuous-time analogue has exponential covariance

C(τ)=σX2e−∣τ∣/τc,C(\tau)=\sigma_X^2e^{-|\tau|/\tau_c},

where τc>0\tau_c>0 is a correlation time. Its spectrum is the Lorentzian

S(f)=2σX2τc1+(2πfτc)2.S(f)=\frac{2\sigma_X^2\tau_c} {1+(2\pi f\tau_c)^2}.

The characteristic transition occurs near 1/(2πτc)1/(2\pi\tau_c). Short correlation times spread variance over a broad frequency range; long correlation times concentrate it close to zero. The covariance and spectrum provide complementary descriptions of the same temporal persistence.

Many observed spectra follow an approximate power law, S(f)∝∣f∣−αS(f)\propto |f|^{-\alpha}, over a finite range. Flicker or pink noise commonly denotes behavior near α=1\alpha=1. Such formulas cannot automatically be extended to all frequencies: a stationary finite-variance process requires an integrable spectrum. In particular, a divergence at zero frequency with α≥1\alpha\geq1 is incompatible with finite variance unless modified by a cutoff or another change in behavior.

An ordinary random walk illustrates the danger of formal spectra. It is nonstationary, so the expression proportional to 1/∣1−e−iω∣21/|1-e^{-i\omega}|^2 is not an ordinary finite-variance stationary spectral density. By contrast, an integrable low-frequency singularity with 0<α<10<\alpha<1 can describe stationary long-range dependence. “Large low-frequency power” can therefore indicate either stationary persistence or nonstationarity, depending on the full model.

Linear filtering, sampling, and aliasing

For a stable linear time-invariant system with impulse response h(t)h(t), the output is the convolution

Y(t)=∫−∞∞h(u)X(t−u) du.Y(t)=\int_{-\infty}^{\infty}h(u)X(t-u)\,du.

If the stationary input has spectral density SX(f)S_X(f), and H(f)H(f) is the Fourier transform of hh, then

SY(f)=∣H(f)∣2SX(f).S_Y(f)=|H(f)|^2S_X(f).

This identity converts the calculation of a filtered covariance into multiplication in frequency. A low-pass filter suppresses rapid fluctuations, a band-pass filter isolates a frequency range, and a resonant response can create a pronounced output peak from an input without a corresponding narrow peak.

The output variance is

Var⁡(Y)=∫−∞∞∣H(f)∣2SX(f) df.\operatorname{Var}(Y)= \int_{-\infty}^{\infty}|H(f)|^2S_X(f)\,df.

For a flat input spectrum, this motivates equivalent noise bandwidth: the integral of the squared frequency response divided by a specified reference gain. Noise bandwidth need not equal the frequency interval between half-power points. The distinction matters when comparing filters that have similar nominal cutoff frequencies but different response shapes.

Sampling at interval Δ\Delta produces Xn=X(nΔ)X_n=X(n\Delta), with sampling frequency fs=1/Δf_s=1/\Delta. Under suitable regularity, the sampled spectrum in physical frequency units is

Ssamp(f)=∑k∈ZSX(f+kfs),−fs2≤f<fs2.S_{\mathrm{samp}}(f)= \sum_{k\in\mathbb Z}S_X(f+kf_s), \qquad -\frac{f_s}{2}\leq f<\frac{f_s}{2}.

The shifted copies add because continuous-time frequencies separated by integer multiples of fsf_s produce identical sampled oscillations. This folding of spectral power is aliasing. The integral over the base interval still gives the sampled process’s variance, but the original allocation of power among aliased frequencies cannot generally be recovered.

The sampling theorem gives exact reconstruction conditions for appropriately band-limited signals sampled above twice their highest frequency. Real random noise often has no strict upper frequency limit, so an analog anti-aliasing filter is important before sampling. Filtering the data after acquisition cannot undo an unknown mixture of spectral contributions already folded into the same frequency band.

Changing from physical frequency to angular frequency per sample introduces another scale factor. If s(ω)s(\omega) is normalized by

C[k]=12π∫−ππs(ω)eiωk dω,C[k]=\frac{1}{2\pi}\int_{-\pi}^{\pi} s(\omega)e^{i\omega k}\,d\omega,

then Ssamp(f)=Δs(2πfΔ)S_{\mathrm{samp}}(f)=\Delta s(2\pi f\Delta). Confusing these densities causes errors by factors of the sampling rate, even when the plotted spectral shapes are identical.

Operations applied before estimation also act as filters. First differencing has squared gain ∣1−e−iω∣2=4sin⁡2(ω/2)|1-e^{-i\omega}|^2=4\sin^2(\omega/2), suppressing low frequencies. Finite-sample detrending is not simply an ideal high-pass filter, but it likewise alters low-frequency estimates. Differentiation, when defined in the mean-square sense, multiplies a continuous-time spectrum by (2πf)2(2\pi f)^2, requiring sufficient high-frequency decay for the derivative to have finite variance.

Periodograms, windows, and nonparametric estimation

A spectrum is usually inferred from a finite record rather than calculated from a known covariance. For observations x0,…,xN−1x_0,\ldots,x_{N-1} at spacing Δ\Delta, a two-sided periodogram in physical frequency units is

IN(f)=ΔN∣∑n=0N−1xne−i2πfnΔ∣2.I_N(f)=\frac{\Delta}{N} \left|\sum_{n=0}^{N-1}x_ne^{-i2\pi fn\Delta}\right|^2.

The discrete Fourier transform evaluates this expression efficiently on a frequency grid, while the fast Fourier transform reduces the computational cost of obtaining those values. Fourier computation, however, does not by itself solve the statistical problem of estimating a population spectrum.

Multiplication by a finite observation window becomes convolution in frequency. Consequently, the expected periodogram is a smoothed version of the true spectrum, with smoothing kernel determined by the observation window. A sinusoid whose frequency falls between transform bins spreads power across nearby bins and often more distant ones. This spectral leakage is not necessarily evidence for multiple physical oscillations; it is partly a consequence of restricting observation to a finite interval.

Tapering reduces the abruptness of the record’s endpoints. Windows such as Hann and Hamming suppress sidelobes relative to a rectangular window, at the cost of a broader main lobe. For a taper wnw_n, a common density normalization is

Iw(f)=Δ∑n=0N−1wn2∣∑n=0N−1wnxne−i2πfnΔ∣2.I_w(f)= \frac{\Delta}{\sum_{n=0}^{N-1}w_n^2} \left|\sum_{n=0}^{N-1}w_nx_ne^{-i2\pi fn\Delta}\right|^2.

The squared-weight denominator calibrates mean-square power. A different normalization is needed when the objective is to estimate the amplitude of a coherent sinusoid. Confusing amplitude calibration with noise-density calibration can produce systematic scale errors.

The raw periodogram is generally not a consistent estimator at an individual frequency. Under standard conditions, at an interior positive frequency its value divided by the true spectrum is approximately exponential with mean one. Increasing record length improves frequency localization but does not make this relative variability disappear. Smoothing nearby frequencies or averaging approximately independent spectral estimates is therefore essential for stable nonparametric estimation.

The Welch method divides a record into possibly overlapping, tapered segments and averages their periodograms. Shorter segments increase the number of averages but reduce frequency resolution. Overlapping segments are correlated, so their nominal count is not the effective number of independent averages. Multitaper estimation instead applies several orthogonal tapers to the same record, commonly discrete prolate spheroidal sequences, and combines their spectral estimates.

Zero-padding evaluates the finite-record Fourier transform on a finer grid but does not create new observations or separate components that the observation duration cannot resolve. If an averaged estimate has an effective ν\nu degrees of freedom, an approximate uncertainty model is νS^/S∼χν2\nu\widehat S/S\sim\chi_\nu^2. This supports confidence intervals, subject to assumptions about the process, tapering, averaging, and local smoothness of the spectrum.

Parametric models and frequency-domain inference

Parametric spectral estimation replaces an otherwise unrestricted density with a family indexed by finitely many parameters. For an autoregressive moving-average model,

A(B)Xn=B0(B)εn,A(B)X_n=B_0(B)\varepsilon_n,

the backshift operator satisfies BXn=Xn−1BX_n=X_{n-1}. If the innovation variance is σε2\sigma_\varepsilon^2, the spectral density is

s(ω)=σε2∣B0(e−iω)∣2∣A(e−iω)∣2.s(\omega)=\sigma_\varepsilon^2 \frac{|B_0(e^{-i\omega})|^2} {|A(e^{-i\omega})|^2}.

The notation B0B_0 distinguishes the moving-average polynomial from the backshift operator. Under the usual causal convention, zeros of the autoregressive polynomial lie outside the unit circle for stationarity.

This rational form has a direct interpretation in terms of system dynamics. An autoregressive polynomial zero near the unit circle can produce a narrow spectral peak at the corresponding angle. Complex-conjugate pairs describe damped oscillations in real-valued series. Moving-average factors can create depressions or notches. Thus a small collection of parameters can express behavior that would require substantial smoothing and many frequency bins in a nonparametric estimate.

Parameters can be estimated by covariance equations, prediction-error methods, or maximum likelihood. Autoregressive fitting through the Yule–Walker equations links model coefficients directly to estimated autocovariances. A fitted model can then provide both a spectral estimate and a prediction rule. The apparent smoothness of a parametric spectrum is supplied partly by model restrictions, not solely by information in the observations.

The Whittle likelihood is a frequency-domain approximation to Gaussian time-series likelihood. Up to normalization and constants, its negative log-likelihood has the form

L(θ)=∑j[log⁡sθ(ωj)+I(ωj)sθ(ωj)],L(\theta)= \sum_j\left[ \log s_\theta(\omega_j) +\frac{I(\omega_j)}{s_\theta(\omega_j)} \right],

where II and sθs_\theta use matching conventions. It exploits the approximate decorrelation of Fourier coefficients at distinct Fourier frequencies in long stationary records. The approximation can be inaccurate for short records, strong spectral leakage, or pronounced behavior close to zero frequency.

Model order controls a familiar bias–variance tradeoff. Too few parameters can flatten or merge real peaks; too many can fit random fluctuations and create spurious narrow components. Information criteria, predictive checks, and residual analysis assess different aspects of model adequacy. A residual spectrum that remains strongly structured indicates that the fitted model has not removed all second-order temporal dependence.

Spectral peaks alone do not establish an external periodic forcing. A stochastic system with a damped resonance can generate a peak without any deterministic clock. Likewise, a high fitted peak is not automatically statistically significant: its interpretation depends on the background spectrum, parameter uncertainty, and how many candidate frequencies were examined. Bayesian spectral methods express uncertainty through a posterior over models or densities, but their resolution and conclusions also depend on the chosen prior and likelihood.

Cross-spectra, spatial spectra, and changing frequency structure

For two jointly stationary processes, define the cross-covariance by

CXY(τ)=E[(X(t+τ)−μX)(Y(t)−μY)‾].C_{XY}(\tau)= \mathbb E[(X(t+\tau)-\mu_X)\overline{(Y(t)-\mu_Y)}].

Its Fourier transform is the cross-spectral density SXY(f)S_{XY}(f). Unlike an autospectrum, a cross-spectrum can be complex: its magnitude describes shared frequency-dependent variation, while its phase describes the relative alignment of oscillatory components under the stated lag convention. Reversing the order of the processes conjugates the cross-spectrum.

For a vector process, the auto- and cross-spectra form a spectral density matrix. At each frequency this matrix is Hermitian and positive semidefinite. In particular,

∣SXY(f)∣2≤SXX(f)SYY(f).|S_{XY}(f)|^2\leq S_{XX}(f)S_{YY}(f).

Where the denominator is positive, magnitude-squared coherence is

γXY2(f)=∣SXY(f)∣2SXX(f)SYY(f),\gamma_{XY}^2(f)= \frac{|S_{XY}(f)|^2}{S_{XX}(f)S_{YY}(f)},

and lies between zero and one. It measures linear frequency-specific association. A third process can drive both records, so coherence does not by itself establish causation or identify a direction of influence.

For a pure delay Y(t)=X(t−τ0)Y(t)=X(t-\tau_0), the transfer function is e−i2πfτ0e^{-i2\pi f\tau_0}. With the definition above, SYX(f)=e−i2πfτ0SXX(f)S_{YX}(f)=e^{-i2\pi f\tau_0}S_{XX}(f). The cross-spectral phase therefore changes linearly with frequency, modulo 2π2\pi. Phase unwrapping can make that slope visible, but interpreting it as a unique delay requires an appropriate system model. General filters can have frequency-dependent phase responses that do not represent a single transit time.

Spatially stationary random fields use wave-number vectors instead of temporal frequency. For a field on Rd\mathbb R^d, one convention is

C(r)=∫RdS(k)eik⋅rddk(2π)d.C(\mathbf r)=\int_{\mathbb R^d} S(\mathbf k)e^{i\mathbf k\cdot\mathbf r} \frac{d^d\mathbf k}{(2\pi)^d}.

When the field is isotropic, the density depends only on ∣k∣|\mathbf k|. A radial spectrum formed by integrating over spherical shells contains an additional geometric factor proportional to kd−1k^{d-1}. Its numerical shape is therefore not identical to the underlying density per unit wave-number volume. This distinction is important when comparing spectra across spatial dimensions or with turbulence energy spectra.

A single global stationary spectrum cannot describe when an oscillation occurs. Short-time Fourier methods estimate spectra in moving windows, while wavelet methods vary temporal resolution with scale. These methods require a compromise between time localization and frequency localization. A process whose oscillation frequency changes over a record can have a broad global spectrum even if its instantaneous oscillation is narrowly concentrated. Time-frequency representations address this limitation, but their definitions and positivity properties differ; not every such representation is a local power spectral density.

Historical development and scientific applications

Spectral analysis developed from harmonic analysis, particularly the representation of functions by sinusoidal components. Joseph Fourier’s 1822 work on heat supplied a major mathematical foundation for Fourier expansions and transforms. Extending these ideas from deterministic functions to irregular observations required a different object: not simply the transform of a waveform, but the frequency distribution of its second-order variation. Arthur Schuster introduced the term “periodogram” in 1898 in work on periodicities in observations.

During the early twentieth century, spectral methods became central to the study of random fluctuations. Norbert Wiener’s 1930 work on generalized harmonic analysis and Aleksandr Khinchin’s 1934 work on stationary random processes established the classical connection between correlation and spectrum. Harald Cramér developed spectral representations of stationary processes, while Andrey Kolmogorov and Wiener connected stationary-process theory with prediction and filtering. These developments made spectra part of probability theory rather than only a computational technique for finding cycles.

Practical estimation advanced alongside electronic instrumentation and digital computation. Maurice Bartlett developed averaging approaches that reduced periodogram variability. John Tukey and collaborators emphasized smoothing and lag-window methods. Peter Welch’s 1967 method combined segment averaging, tapering, and efficient Fourier computation. David Thomson’s 1982 multitaper work provided a systematic framework for controlling leakage and estimating uncertainty using multiple orthogonal data tapers. These methods address different compromises among resolution, statistical stability, and spectral contamination.

In electrical measurements, spectral density quantifies noise contributed by components and instruments. In the classical thermal regime, an ideal resistor’s open-circuit voltage noise has one-sided density

SV(1)(f)=4kBTR,S_V^{(1)}(f)=4k_{\mathrm B}TR,

where kBk_{\mathrm B} is Boltzmann’s constant, TT is absolute temperature, and RR is resistance. A bandwidth BB over which the model is flat therefore gives mean-square noise voltage 4kBTRB4k_{\mathrm B}TRB. The expression assumes the classical low-frequency thermal regime and does not extend unchanged to arbitrarily high frequencies.

In mechanical and structural testing, acceleration spectra describe vibration environments and resonances. Integrating an acceleration density over a band gives that band’s mean-square acceleration; converting acceleration to displacement involves frequency-dependent integration and can strongly amplify low-frequency contributions. In geophysics and climate research, spectra characterize variability across temporal and spatial scales, but trends, finite records, and red-noise backgrounds complicate the identification of periodic components.

In quantum mechanics, noise spectra require an additional distinction because observables at different times need not commute. Symmetrized and unsymmetrized correlation functions define different spectra, and positive- and negative-frequency components can encode different transition processes. In operator theory, “spectral density” may instead refer to the density of an operator’s spectral measure; a density of states counts modes or energy levels per interval. These uses share a measure-theoretic language with power spectral density but describe different quantities and require their own normalizations.