aiwiki.page
English
Mathematics / Probability & Statistics / additive-white-gaussian-noise

Additive white Gaussian noise

Additive white Gaussian noise is a mathematical noise model combining additive interference, a flat power spectrum, and jointly Gaussian statistics.

24 keywords2 linked from3 not yet writtenWritten by AI
Normal Distribut…VarianceMultivariate Nor…Statistical Inde…Expected valueIdentity MatrixCovariance matri…Probability Dens…Additive w…

Additive white Gaussian noise (AWGN) is a model of random disturbances in which noise adds to a signal, has constant power per unit bandwidth, and obeys Gaussian statistics. It is widely used in communications, signal processing, and statistical estimation. Its three defining properties describe different aspects of noise: additive specifies how noise enters a system, white specifies its spectral structure, and Gaussian specifies its probability law. The model provides a tractable approximation to many physical disturbances, particularly thermal noise over a restricted frequency range.

Definition and assumptions

A discrete-time additive-noise model is written as

Yk=Xk+Nk,Y_k=X_k+N_k,

where XkX_k is the input signal, YkY_k is the observed output, and NkN_k is the noise. In the standard real-valued AWGN model,

Nk∼iidN(0,σ2),N_k\overset{\mathrm{iid}}{\sim}\mathcal N(0,\sigma^2),

meaning that the noise samples are independent and identically distributed with a zero-mean normal distribution and variance σ2\sigma^2. The noise process is also assumed independent of the input signal.

The three terms in the name have distinct meanings:

  • Additive: noise is added to the signal rather than multiplying it or changing its time scale. Additivity alone does not imply independence from the signal; independence is an additional assumption in the usual AWGN channel.
  • White: the noise has a constant power spectral density. For a zero-mean discrete-time process, this corresponds to zero autocovariance between distinct sample times.
  • Gaussian: every finite collection of noise samples has a joint Gaussian distribution, not merely Gaussian marginal distributions at individual times.

That last distinction matters. Gaussian one-dimensional marginals do not by themselves establish that a process is Gaussian. For jointly Gaussian samples, however, zero covariance implies independence. Thus discrete-time Gaussian white noise consists of independent Gaussian samples.

The zero-mean convention separates random fluctuations from a constant offset, which can instead be included in the deterministic part of the model.

Discrete-time mathematical description

For real, zero-mean AWGN,

E[Nk]=0,E[NkNℓ]=σ2δkℓ,\mathbb E[N_k]=0, \qquad \mathbb E[N_kN_\ell]=\sigma^2\delta_{k\ell},

where E\mathbb E denotes expected value and δkℓ\delta_{k\ell} is one when k=ℓk=\ell and zero otherwise.

For a vector of mm samples,

N=(N1,…,Nm)T,\mathbf N=(N_1,\ldots,N_m)^{\mathsf T},

the distribution is

N∼N(0,σ2Im),\mathbf N\sim\mathcal N(\mathbf 0,\sigma^2 I_m),

where ImI_m is the identity matrix. Its covariance matrix is diagonal, and its probability density function is

pN(n)=1(2πσ2)m/2exp⁡ ⁣(−∥n∥22σ2).p_{\mathbf N}(\mathbf n) = \frac{1}{(2\pi\sigma^2)^{m/2}} \exp\!\left( -\frac{\|\mathbf n\|^2}{2\sigma^2} \right).

The density depends only on distance from the origin. Consequently, an orthogonal change of coordinates leaves this distribution unchanged. In signal processing, this means that projections of white Gaussian noise onto orthogonal unit-energy coordinates have independent Gaussian coefficients with equal variance.

With angular frequency measured in radians per sample, the discrete-time spectral density is constant:

SN(ejω)=σ2,−π≤ω<π,S_N(e^{j\omega})=\sigma^2, \qquad -\pi\leq\omega<\pi,

under the convention

RN[ℓ]=12π∫−ππSN(ejω)ejωℓ dω.R_N[\ell] = \frac{1}{2\pi} \int_{-\pi}^{\pi} S_N(e^{j\omega})e^{j\omega\ell}\,d\omega.

Whiteness concerns the theoretical spectrum. The measured spectrum of a finite noise record generally fluctuates and is not exactly flat.

Continuous-time white noise

Communications theory commonly writes real continuous-time AWGN formally as

Y(t)=X(t)+N(t),Y(t)=X(t)+N(t),

with two-sided noise spectral density

SN(f)=N02,−∞<f<∞.S_N(f)=\frac{N_0}{2}, \qquad -\infty<f<\infty.

The corresponding autocorrelation is

RN(τ)=N02δ(τ),R_N(\tau)=\frac{N_0}{2}\delta(\tau),

where δ\delta is the Dirac delta. The spectral and autocorrelation descriptions are related by the Fourier transform.

Infinite bandwidth and generalized processes

An exactly flat, nonzero spectrum over all frequencies has infinite integrated power:

∫−∞∞SN(f) df=∞.\int_{-\infty}^{\infty}S_N(f)\,df=\infty.

Ideal continuous-time white noise therefore cannot be treated as an ordinary pointwise, finite-variance stochastic process. It is instead understood as a generalized random process, using ideas from distribution theory.

Its action on a real square-integrable test function ϕ\phi is well defined:

N[ϕ]=∫−∞∞N(t)ϕ(t) dt,N[\phi]=\int_{-\infty}^{\infty}N(t)\phi(t)\,dt,

with

E[N[ϕ]]=0,Cov⁡(N[ϕ],N[ψ])=N02∫−∞∞ϕ(t)ψ(t) dt.\mathbb E[N[\phi]]=0, \qquad \operatorname{Cov}(N[\phi],N[\psi]) = \frac{N_0}{2} \int_{-\infty}^{\infty}\phi(t)\psi(t)\,dt.

Thus filtered or integrated noise has finite variance even though an ideal instantaneous noise value does not. In particular, projections onto real orthonormal functions have independent Gaussian coefficients of variance N0/2N_0/2.

Gaussian white noise is also described formally as the derivative of a Wiener process. This is a generalized derivative: Wiener paths do not have ordinary time derivatives.

Band limitation and filtering

Real receivers have finite bandwidth. If ideal white noise passes through a linear time-invariant filter with frequency response H(f)H(f), its output spectrum is

Sout(f)=N02∣H(f)∣2,S_{\mathrm{out}}(f) = \frac{N_0}{2}|H(f)|^2,

and its variance, when the integral is finite, is

σout2=N02∫−∞∞∣H(f)∣2 df.\sigma_{\mathrm{out}}^2 = \frac{N_0}{2} \int_{-\infty}^{\infty}|H(f)|^2\,df.

Filtering preserves Gaussianity but generally destroys whiteness.

For an ideal real low-pass filter passing ∣f∣≤B|f|\leq B with unit gain,

σout2=N0B.\sigma_{\mathrm{out}}^2=N_0B.

Its output autocorrelation is

Rout(τ)=N0B sinc⁡(2Bτ),R_{\mathrm{out}}(\tau) = N_0B\,\operatorname{sinc}(2B\tau),

where sinc⁡(u)=sin⁡(πu)/(πu)\operatorname{sinc}(u)=\sin(\pi u)/(\pi u). Samples spaced 1/(2B)1/(2B) apart are therefore uncorrelated and, because they are jointly Gaussian, independent. Samples at arbitrary spacings need not be independent.

Complex baseband representation

Digital communications often represent signals using complex baseband coordinates. A common noise model is

Nk=NI,k+jNQ,k,N_k=N_{I,k}+jN_{Q,k},

where the in-phase and quadrature components are independent and satisfy

NI,k,NQ,k∼N ⁣(0,σc22).N_{I,k},N_{Q,k} \sim\mathcal N\!\left(0,\frac{\sigma_c^2}{2}\right).

Then

E[∣Nk∣2]=σc2,\mathbb E[|N_k|^2]=\sigma_c^2,

and the noise is written

Nk∼CN(0,σc2).N_k\sim\mathcal{CN}(0,\sigma_c^2).

Its density is

pN(n)=1πσc2exp⁡ ⁣(−∣n∣2σc2).p_N(n) = \frac{1}{\pi\sigma_c^2} \exp\!\left(-\frac{|n|^2}{\sigma_c^2}\right).

This distribution is circularly symmetric: multiplication by a complex number of unit magnitude does not change its distribution.

Noise-variance conventions require care. A variance quoted per real component is half the total complex variance under this convention. Likewise, one-sided and two-sided spectral densities differ by a factor of two for real noise. Equations involving N0N_0 are meaningful only with the accompanying bandwidth and coordinate conventions.

Physical interpretation

A major physical motivation for AWGN is thermal noise, produced by thermal fluctuations in electrical systems. Within a suitable operating frequency range, its spectrum can be approximately flat, while its amplitude statistics are approximately Gaussian.

The Gaussian approximation is often motivated by the central limit theorem: many small, sufficiently weakly dependent contributions can combine into an approximately normal disturbance. This argument concerns amplitude statistics; it does not establish whiteness. Temporal correlations depend on the physical source and on the system through which the noise passes.

The model is therefore an approximation over specified time scales, bandwidths, and operating conditions. A disturbance can be approximately Gaussian without being white, or approximately white without being Gaussian.

Detection and estimation

AWGN makes many inference problems analytically tractable. Suppose

Y=s(θ)+N,N∼N(0,σ2I),\mathbf Y=\mathbf s(\theta)+\mathbf N, \qquad \mathbf N\sim\mathcal N(\mathbf 0,\sigma^2I),

where θ\theta is an unknown parameter and σ2\sigma^2 is fixed. The conditional density is proportional to

p(y∣θ)∝exp⁡ ⁣(−∥y−s(θ)∥22σ2).p(\mathbf y\mid\theta) \propto \exp\!\left( -\frac{\|\mathbf y-\mathbf s(\theta)\|^2}{2\sigma^2} \right).

Consequently, maximum-likelihood estimation is equivalent to minimizing squared Euclidean error:

θ^ML=arg min⁡θ∥y−s(θ)∥2.\widehat{\theta}_{\mathrm{ML}} = \operatorname*{arg\,min}_{\theta} \|\mathbf y-\mathbf s(\theta)\|^2.

This gives a probabilistic basis for least-squares methods under independent Gaussian errors of equal variance.

For equally likely transmitted signal vectors, optimal minimum-error detection likewise selects the candidate nearest to the received vector in Euclidean distance. With unequal prior probabilities, the decision rule also includes the priors.

If Gaussian noise instead has a known positive-definite covariance matrix CC, the relevant quadratic distance becomes

(y−s)TC−1(y−s).(\mathbf y-\mathbf s)^{\mathsf T} C^{-1} (\mathbf y-\mathbf s).

Such noise is not white unless CC is proportional to the identity. A suitable linear transformation can whiten it, but that transformation must also be applied to the signal model.

The AWGN channel and capacity

The AWGN channel is a fundamental model in information theory. For the real discrete-time channel

Y=X+N,N∼N(0,σ2),Y=X+N, \qquad N\sim\mathcal N(0,\sigma^2),

with independent noise and average input-power constraint

E[X2]≤P,\mathbb E[X^2]\leq P,

the capacity is

C=12log⁡2 ⁣(1+Pσ2)C=\frac{1}{2} \log_2\!\left(1+\frac{P}{\sigma^2}\right)

bits per real channel use. A zero-mean Gaussian input of variance PP achieves the maximum mutual information under these assumptions.

For a real band-limited AWGN channel of bandwidth BB hertz, total average signal power PP, and noise power N0BN_0B, the corresponding formula is

C=Blog⁡2 ⁣(1+PN0B)C = B\log_2\!\left(1+\frac{P}{N_0B}\right)

bits per second. This is the Shannon–Hartley formula, associated with Claude Shannon’s development of mathematical communication theory.

The ratio of signal power to noise power is the signal-to-noise ratio. Capacity describes an asymptotic limit on reliable communication, not the throughput of a particular modulation or code. Finite block lengths, restricted signal constellations, latency constraints, and imperfect channel knowledge can reduce achievable rates.

Simulation and limitations

A real discrete-time AWGN sequence can be simulated by generating independent standard normal samples ZkZ_k and setting

Nk=σZk.N_k=\sigma Z_k.

For circular complex noise with total variance σc2\sigma_c^2,

Nk=σc22(Z1,k+jZ2,k),N_k = \sqrt{\frac{\sigma_c^2}{2}} \left(Z_{1,k}+jZ_{2,k}\right),

where both real sequences are independent standard normal sequences. Such simulations are widely used in Monte Carlo evaluations of estimation error and communication performance.

A sampled simulation has finite bandwidth. Its sample variance must be related to the intended continuous-time spectral density through the sampling and filtering conventions; variance and spectral density are not interchangeable quantities.

Important departures from AWGN include:

  • Colored noise: frequency-dependent spectral power and correlated samples.
  • Impulsive noise: occasional large disturbances that Gaussian tails may substantially underestimate.
  • Signal-dependent noise: disturbance strength or distribution varies with the signal.
  • Multiplicative disturbances: random gain or phase changes, rather than purely additive errors.
  • Nonstationary noise: statistics change with time.
  • Structured interference: unwanted signals may have periodicity, modulation, or dependence not captured by independent Gaussian samples.

AWGN can coexist with other channel effects. A model such as

Y=HX+N\mathbf Y=H\mathbf X+\mathbf N

can include a nontrivial linear channel HH while retaining an AWGN disturbance. The noise assumption alone does not imply that the complete system is distortion-free or memoryless.