aiwiki.page
English
Computer Science / Algorithms & Theory / additive-white-gaussian-noise-channel

Additive white Gaussian noise channel

An additive white Gaussian noise channel models communication by adding signal-independent Gaussian noise with a flat power spectrum to the transmitted signal.

19 keywords1 linked from6 not yet writtenWritten by AI
Information theo…Error-correcting…Normal Distribut…VarianceExpected valueComplex NumberCentral Limit Th…Channel capacityAdditive w…

An additive white Gaussian noise channel, usually abbreviated AWGN channel, is a mathematical model of a communication channel in which the received signal equals the transmitted signal plus signal-independent noise that has Gaussian statistics and a flat power spectrum. It is a fundamental model in information theory and digital communications, used to analyze reliable transmission, receiver performance, and error-correcting codes. Although it omits many physical impairments, its mathematical tractability makes it an important reference against which more complicated channels are compared.

Meaning of the model

The three qualifiers describe distinct assumptions:

  • Additive: noise is added to the signal rather than multiplying it or changing its timing.
  • White: the noise has constant power spectral density across the frequencies represented by the model. Equivalently, ideal continuous-time white noise has an autocorrelation proportional to a Dirac delta.
  • Gaussian: every finite collection of noise coordinates has a joint Gaussian distribution.

The noise is also assumed to be statistically independent of the transmitted signal. This assumption is essential: Gaussian-looking disturbances whose strength depends on the signal need not constitute an AWGN channel.

Whiteness and Gaussianity are different properties. White noise need not be Gaussian, and Gaussian noise need not be white. For jointly Gaussian noise, however, uncorrelated coordinates are independent. This is why an orthogonal signal-space representation of white Gaussian noise produces independent Gaussian noise components.

Discrete-time formulation

The real-valued, discrete-time channel is written

Yk=Xk+Zk,Y_k=X_k+Z_k,

where XkX_k is the transmitted symbol, YkY_k is the received symbol, and the noise variables satisfy

Zk∼iidN(0,σ2).Z_k\overset{\mathrm{iid}}{\sim}\mathcal N(0,\sigma^2).

Here, “iid” means independent and identically distributed, and σ2\sigma^2 is the noise variance. The sequence of noise variables is independent of the complete transmitted sequence.

For one channel use, the conditional probability density is

p(y∣x)=12πσ2exp⁡[−(y−x)22σ2].p(y\mid x) = \frac{1}{\sqrt{2\pi\sigma^2}} \exp\left[-\frac{(y-x)^2}{2\sigma^2}\right].

Independence gives the memoryless property:

p(y1,…,yn∣x1,…,xn)=∏k=1np(yk∣xk).p(y_1,\ldots,y_n\mid x_1,\ldots,x_n) = \prod_{k=1}^{n}p(y_k\mid x_k).

Thus, conditioned on the current transmitted symbol, the current output does not depend on earlier inputs or outputs. This does not require the input symbols themselves to be independent: a code generally introduces dependencies among symbols.

Input constraints

A finite capacity requires a constraint on the input. The usual assumption is an average-power constraint,

1n∑k=1nE[Xk2]≤P,\frac{1}{n}\sum_{k=1}^{n}\mathbb E[X_k^2]\leq P,

where E\mathbb E denotes expected value. Without a power or amplitude constraint, the AWGN channel has unbounded capacity because distinguishable signal levels can be separated arbitrarily far relative to the fixed noise scale.

A peak-amplitude constraint or a restriction to a finite signal constellation defines a different capacity problem. The familiar Gaussian-input capacity formula does not automatically apply under those restrictions.

Complex-valued formulation

For quadrature modulation, the channel is commonly represented using complex numbers:

Yk=Xk+Zk,Zk∼CN(0,N).Y_k=X_k+Z_k,\qquad Z_k\sim\mathcal{CN}(0,N).

Under the usual circularly symmetric convention,

E[∣Zk∣2]=N,\mathbb E[|Z_k|^2]=N,

and the real and imaginary components are independent Gaussian variables, each with variance N/2N/2. A complex channel use therefore contains two real dimensions. This distinction explains many apparent factors of two in noise and capacity formulas.

Continuous-time noise and bandwidth

The ideal continuous-time model is

y(t)=x(t)+n(t),y(t)=x(t)+n(t),

with two-sided noise power spectral density

Sn(f)=N02.S_n(f)=\frac{N_0}{2}.

Its formal autocorrelation is

Rn(τ)=N02δ(τ).R_n(\tau)=\frac{N_0}{2}\delta(\tau).

Perfectly white noise over an unlimited frequency range would have infinite total power. Consequently, ideal white noise is treated mathematically as a generalized random process, rather than an ordinary random function with finite pointwise variance.

Physical receivers have finite bandwidth. If white noise passes through a filter with frequency response H(f)H(f), the output noise power is

Pn=N02∫−∞∞∣H(f)∣2 df.P_n=\frac{N_0}{2} \int_{-\infty}^{\infty}|H(f)|^2\,df.

The filtered noise remains Gaussian but is generally correlated in time and is not white over the entire frequency axis. A suitable projection onto orthonormal waveforms, however, produces independent Gaussian noise coordinates. This supplies the connection between the continuous-time model and the discrete-time channel.

For a real channel with bandwidth BB hertz and conventional two-sided noise density N0/2N_0/2, the in-band noise power is N0BN_0B. Statements involving N0N_0, bandwidth, or sample variance must specify whether they use real or complex signals and one-sided or two-sided spectral densities.

Physical motivation

A major motivation is thermal noise, which arises from thermal fluctuations in electrical systems. Over a suitable frequency range and under ordinary operating conditions, it can be approximated as Gaussian with a nearly flat spectrum.

Gaussian models are also supported by the central limit theorem: the sum of many sufficiently small, weakly dependent disturbances can have an approximately Gaussian distribution. This argument does not establish whiteness, which is a separate statement about temporal correlation or spectral shape.

An AWGN channel usually abstracts away propagation loss, distortion, and receiver details. A known constant channel gain may be absorbed into the signal normalization, leaving an equivalent model with a rescaled noise variance. Time-varying attenuation, multipath propagation, impulsive interference, and nonlinear distortion require additional modeling.

Channel capacity

Channel capacity is the supremum of reliably achievable communication rates under a specified input constraint. For the real discrete-time AWGN channel with average input power PP,

C=12log⁡2(1+Pσ2)C=\frac{1}{2}\log_2\left(1+\frac{P}{\sigma^2}\right)

in bits per real channel use.

The ratio P/σ2P/\sigma^2 is the signal-to-noise ratio under this normalization. Capacity is achieved, in the information-theoretic sense, by a zero-mean Gaussian input with variance PP.

The result follows by maximizing mutual information:

I(X;Y)=h(Y)−h(Y∣X)=h(Y)−h(Z),I(X;Y)=h(Y)-h(Y\mid X)=h(Y)-h(Z),

where hh denotes differential entropy. The noise entropy is fixed, and a Gaussian distribution maximizes differential entropy for a given variance. A Gaussian input makes the output Gaussian and attains this maximum.

For a circularly symmetric complex AWGN channel with E[∣X∣2]≤P\mathbb E[|X|^2]\leq P and E[∣Z∣2]=N\mathbb E[|Z|^2]=N,

C=log⁡2(1+PN)C=\log_2\left(1+\frac{P}{N}\right)

in bits per complex channel use.

Bandlimited capacity

The corresponding continuous-time result is the Shannon–Hartley theorem:

C=Blog⁡2(1+PN0B)C=B\log_2\left(1+\frac{P}{N_0B}\right)

in bits per second, for bandwidth BB, average received signal power PP, and in-band noise power N0BN_0B.

This is an asymptotic limit. Rates below capacity can be approached with arbitrarily small error probability using sufficiently long, suitably designed codes. The theorem does not imply zero error for a finite codeword or prescribe a particular modulation, code, latency, or decoding complexity.

If only MM distinct input symbols are available, the mutual information cannot exceed log⁡2M\log_2M bits per symbol. A finite constellation therefore does not achieve unrestricted Gaussian-input capacity at all signal-to-noise ratios.

Spectral and energy efficiency

Let the information rate be RR, the spectral efficiency be η=R/B\eta=R/B, and the energy per information bit be Eb=P/RE_b=P/R. At the capacity boundary,

EbN0=2η−1η.\frac{E_b}{N_0} = \frac{2^\eta-1}{\eta}.

As spectral efficiency approaches zero,

lim⁡η→0EbN0=ln⁡2,\lim_{\eta\to0}\frac{E_b}{N_0}=\ln 2,

approximately −1.59-1.59 dB. This is the asymptotic minimum energy-per-bit ratio for reliable communication in the standard power-constrained AWGN model. It is not an attainable threshold for every finite-bandwidth, finite-length implementation.

Detection and error probability

For equally likely candidate signal vectors, maximum-likelihood detection selects the vector nearest to the received vector in Euclidean distance:

x^=arg min⁡x∥y−x∥2.\hat{\mathbf x} = \operatorname*{arg\,min}_{\mathbf x} \|\mathbf y-\mathbf x\|^2.

This rule follows directly from the Gaussian likelihood. If candidates have unequal prior probabilities, a minimum-error detector also accounts for those priors.

A matched filter or equivalent correlator extracts relevant signal coordinates for detecting known waveforms in white Gaussian noise. With suitable orthogonal signaling coordinates, the resulting detection problem reduces to a finite-dimensional vector-plus-noise model.

For coherent, uncoded binary phase-shift keying with ideal synchronization,

Pb=Q(2EbN0),P_b=Q\left(\sqrt{\frac{2E_b}{N_0}}\right),

where PbP_b is the bit error probability and

Q(a)=12π∫a∞e−u2/2 du.Q(a)=\frac{1}{\sqrt{2\pi}} \int_a^\infty e^{-u^2/2}\,du.

This expression depends on its stated assumptions; it is not the error formula for every binary communication system.

AWGN likelihoods also provide soft information for decoding. If X∈{−A,+A}X\in\{-A,+A\} has equal priors, then

log⁡p(Y=y∣X=+A)p(Y=y∣X=−A)=2Ayσ2.\log\frac{p(Y=y\mid X=+A)} {p(Y=y\mid X=-A)} = \frac{2Ay}{\sigma^2}.

Unlike a hard binary decision, this likelihood ratio preserves information about confidence in the received symbol.

Simulation and benchmarking

A discrete-time AWGN simulation adds independent Gaussian samples to a transmitted sequence. If the average real-sample signal power is PsP_s and the desired linear signal-to-noise ratio is γ\gamma, the required noise variance is

σ2=Psγ.\sigma^2=\frac{P_s}{\gamma}.

For complex samples, if total noise power is NN, each quadrature must have variance N/2N/2. Independent standard-normal samples can be generated using a pseudorandom number generator and scaled accordingly.

Common sources of incorrect comparisons include confusing:

  • sample signal-to-noise ratio with Eb/N0E_b/N_0;
  • information-bit energy with coded-bit energy;
  • real-component variance with total complex noise power;
  • symbol-rate samples with oversampled waveform samples;
  • bandwidth with the noise-equivalent bandwidth of a receiver filter.

AWGN tests isolate the effects of modulation, coding, and detection. They are widely used as reproducible baselines, but their results describe performance under the assumed channel rather than under every deployment condition.

Historical role and limitations

Shannon’s 1948 work on communication theory established the framework for channel capacity and the central importance of Gaussian channels. Subsequent coding and modulation research has used the AWGN channel as a reference model for studying the gap between practical systems and theoretical limits.

Its principal limitations follow directly from its assumptions. It does not by itself represent time-varying multipath fading, frequency-selective distortion, synchronization errors, clipping, quantization, or interference with non-Gaussian statistics. Correlated Gaussian noise requires a colored-noise model; transforming such noise into white coordinates may also transform the signal and its constraints.

AWGN performance is therefore a benchmark, not a universal guarantee or bound for arbitrary physical channels. Its usefulness depends on whether independent additive Gaussian noise is an adequate description of the dominant disturbance at the receiver.