{
  "id": "shannon-hartley-theorem",
  "title": "Shannon–Hartley theorem",
  "lang": "en",
  "source_lang": "en",
  "summary": "The Shannon–Hartley theorem gives the maximum reliable information rate of a bandwidth-limited communication channel subject to additive white Gaussian noise and an average signal-power constraint.",
  "category": "mathematics",
  "subcategory": "applied",
  "type": "concept",
  "aliases": [
    "Shannon–Hartley law",
    "Shannon capacity formula"
  ],
  "generated_at": "2026-11-05",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/shannon-hartley-theorem/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/shannon-hartley-theorem/",
      "json": "https://aiwiki.page/zh/shannon-hartley-theorem.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "The Shannon–Hartley theorem states that the channel capacity of a bandwidth-limited communication channel with additive white Gaussian noise is\n\n\\[C=B\\log_2\\left(1+\\frac{S}{N}\\right),\\]\n\nwhere \\(C\\) is the maximum reliable information rate in bits per second, \\(B\\) is the channel bandwidth in hertz, \\(S\\) is the average received signal power, and \\(N\\) is the total noise power within that bandwidth. A central result of information theory, it connects the physical resources of bandwidth and power to the mathematical limits of communication."
    },
    {
      "heading": "Statement and assumptions",
      "text": "The theorem concerns an idealized channel described by\n\n\\[Y(t)=X(t)+Z(t),\\]\n\nwhere \\(X(t)\\) is the transmitted waveform as received through the noiseless part of the channel, \\(Z(t)\\) is noise, and \\(Y(t)\\) is the observed waveform. The standard assumptions are:\n\n- Limited bandwidth: communication uses a frequency band of width \\(B\\).\n- An average-power constraint: the received signal power cannot exceed \\(S\\).\n- Additive noise: noise is added to the signal rather than multiplying or otherwise distorting it.\n- Gaussian noise: finite collections of noise values have a joint Gaussian distribution.\n- White noise: the noise has constant power spectral density over the relevant band.\n- Noise independent of the input: the noise statistics do not depend on the transmitted message or waveform.\n\nGaussian noise is associated with the normal distribution. Ideal white noise over all frequencies would have infinite total power; only its power within the channel’s finite bandwidth enters the theorem.\n\nThe ratio \\(S/N\\) is the signal-to-noise ratio, or SNR, expressed as a linear power ratio. If the SNR is supplied in decibels, it must first be converted:\n\n\\[\\mathrm{SNR}_{\\mathrm{linear}} =10^{\\mathrm{SNR}_{\\mathrm{dB}}/10}.\\]\n\nFor example, \\(20\\) dB corresponds to \\(S/N=100\\), not \\(20\\).\n\n“Reliable” has an asymptotic meaning. For every transmission rate strictly below \\(C\\), there are sequences of codes whose probability of decoding error approaches zero as the code length increases. At rates above \\(C\\), arbitrarily small error probability is impossible under the stated channel and power constraints. The theorem does not promise zero errors for a finite message, nor does it provide a practical code achieving capacity."
    },
    {
      "heading": "Historical development",
      "text": "The theorem brings together work on signaling rates and the mathematical treatment of information.\n\nIn the 1920s, Harry Nyquist studied the relationship between bandwidth and signaling rate. For an ideal real low-pass channel of bandwidth \\(B\\), there are approximately \\(2B\\) independent real signaling dimensions per second. Ralph Hartley’s 1928 work related information to the number of distinguishable possible messages, using a logarithmic measure.\n\nIn 1948, Claude Shannon established the mathematical theory of communication, including the principle that noise does not necessarily prevent arbitrarily reliable transmission at a positive rate. His analysis of the band-limited Gaussian channel produced the capacity expression now commonly called the Shannon–Hartley theorem.\n\nThe theorem is a particular channel-capacity result, not the entirety of Shannon’s noisy-channel coding theorem. The latter establishes the broader relationship between channel capacity and reliable coding."
    },
    {
      "heading": "Information-theoretic derivation",
      "text": "A single real Gaussian channel use\n\nConsider the discrete model\n\n\\[Y=X+Z,\\]\n\nwhere \\(Z\\) is a zero-mean Gaussian random variable with variance \\(\\sigma^2\\), independent of \\(X\\). Suppose the input satisfies\n\n\\[\\mathbb{E}[X^2]\\leq P,\\]\n\nwhere \\(\\mathbb{E}\\) denotes expected value.\n\nThe information conveyed by one channel use is measured by mutual information:\n\n\\[I(X;Y)=h(Y)-h(Y\\mid X)=h(Y)-h(Z),\\]\n\nwhere \\(h\\) is differential entropy, measured here using base-two logarithms.\n\nAmong real-valued distributions with a specified variance, the Gaussian distribution has the greatest differential entropy. Because\n\n\\[\\operatorname{Var}(Y)\\leq P+\\sigma^2,\\]\n\nit follows that\n\n\\[I(X;Y)\\leq \\frac12\\log_2\\left(1+\\frac{P}{\\sigma^2}\\right).\\]\n\nEquality is attained by a zero-mean Gaussian input with variance \\(P\\). Thus the capacity of one real Gaussian channel use is\n\n\\[C_{\\mathrm{real}} =\\frac12\\log_2\\left(1+\\frac{P}{\\sigma^2}\\right)\\]\n\nbits per use.\n\nFrom channel uses to bandwidth\n\nA real band-limited channel of bandwidth \\(B\\) provides approximately \\(2B\\) independent real dimensions per second over long observation intervals. This relationship is closely connected with the sampling theorem, although the capacity argument must also account for noise and power in the signal-space representation.\n\nMultiplying the capacity per real dimension by the number of dimensions per second gives\n\n\\[C=2B\\cdot\\frac12\\log_2\\left(1+\\frac{S}{N}\\right) =B\\log_2\\left(1+\\frac{S}{N}\\right).\\]\n\nThe factor-of-two conventions differ between real low-pass and complex baseband descriptions, but consistent definitions produce the same physical capacity."
    },
    {
      "heading": "Bandwidth, power, and spectral efficiency",
      "text": "Spectral efficiency\n\nThe capacity per unit bandwidth is\n\n\\[\\eta=\\frac{C}{B} =\\log_2(1+\\mathrm{SNR}),\\]\n\nmeasured in bits per second per hertz. Conversely, achieving a capacity spectral efficiency \\(\\eta\\) requires\n\n\\[\\mathrm{SNR}=2^\\eta-1.\\]\n\nRequired SNR therefore grows exponentially with spectral efficiency. Increasing the amount of information carried in each unit of bandwidth becomes progressively more demanding in signal power.\n\nAt high SNR,\n\n\\[C\\approx B\\log_2(S/N).\\]\n\nIn this regime, doubling signal power adds approximately \\(B\\) bits per second to capacity; it does not double capacity.\n\nAt low SNR, using\n\n\\[\\log_2(1+x)\\approx\\frac{x}{\\ln 2}\\]\n\ngives\n\n\\[C\\approx\\frac{B}{\\ln 2}\\frac{S}{N}.\\]\n\nWhy additional bandwidth does not give unlimited capacity\n\nIf white noise has two-sided power spectral density \\(N_0/2\\), its power in a real channel of bandwidth \\(B\\) is\n\n\\[N=N_0B.\\]\n\nThe capacity formula becomes\n\n\\[C=B\\log_2\\left(1+\\frac{S}{N_0B}\\right).\\]\n\nAt fixed received signal power and noise spectral density, increasing bandwidth also admits more noise. Capacity increases, but approaches a finite limit:\n\n\\[\\lim_{B\\to\\infty}C =\\frac{S}{N_0\\ln 2}.\\]\n\nThis differs from increasing bandwidth while artificially holding total noise power fixed. The physical quantity held constant must be specified when discussing bandwidth–capacity trade-offs.\n\nEnergy per bit\n\nLet \\(E_b=S/R\\) be the received energy per information bit at transmission rate \\(R\\). At the capacity boundary, setting \\(R=C\\) yields\n\n\\[\\frac{E_b}{N_0} =\\frac{2^\\eta-1}{\\eta}.\\]\n\nAs spectral efficiency tends to zero,\n\n\\[\\frac{E_b}{N_0}\\longrightarrow\\ln 2,\\]\n\nor approximately \\(-1.59\\) dB.\n\nThis is the minimum received energy-per-bit ratio for reliable communication in the ideal Gaussian channel when arbitrarily low spectral efficiency is permitted. It is not a universal limit independent of the channel model, and it excludes transmitter, receiver, and computation energy."
    },
    {
      "heading": "Numerical example",
      "text": "Consider a channel with bandwidth\n\n\\[B=3{,}000\\ \\text{Hz}\\]\n\nand received SNR of \\(30\\) dB. The linear SNR is \\(1{,}000\\), so\n\n\\[C=3{,}000\\log_2(1{,}001) \\approx29{,}902\\ \\text{bits/s}.\\]\n\nIts theoretical capacity is therefore about \\(29.9\\) kbit/s. A rate below this value is not automatically achievable by any chosen modem: the modulation, coding, block length, and receiver must support it. Practical overhead can further reduce the useful application-data rate."
    },
    {
      "heading": "Relationship to signaling and coding",
      "text": "The Shannon–Hartley theorem concerns information rate, not merely the number of transmitted symbols. Symbol rate and bit rate are distinct: a symbol may represent multiple coded bits, while redundancy used for error correction reduces the net information rate.\n\nFor an ideal noiseless channel with \\(2B\\) real symbols per second and \\(M\\) distinguishable symbol levels, the corresponding signaling expression is\n\n\\[R=2B\\log_2 M.\\]\n\nThis expression does not itself account for the difficulty of distinguishing closely spaced signal levels in noise. Increasing \\(M\\) at fixed power makes those levels harder to distinguish.\n\nThe Shannon–Hartley theorem incorporates that limitation through the SNR. Error-correcting codes exploit structure across many channel uses so that a receiver can distinguish messages more reliably than it could by decoding each symbol separately.\n\nThe capacity-achieving input for the average-power-constrained Gaussian channel is Gaussian. Fixed finite signal constellations generally have a lower achievable information rate. Practical systems can approach Gaussian-channel capacity through combinations of coding, larger constellations, and signal shaping, but the theorem alone does not determine a suitable implementation."
    },
    {
      "heading": "Extensions and limitations",
      "text": "Colored noise and frequency-selective channels\n\nWhen channel gain or noise power varies with frequency, a single SNR may not adequately describe the channel. Under an appropriate one-sided, nonduplicated frequency convention, capacity takes the form\n\n\\[C= \\max_{P(f)} \\int_{\\mathcal B} \\log_2\\left( 1+\\frac{|H(f)|^2P(f)}{N(f)} \\right)\\,df,\\]\n\nsubject to\n\n\\[P(f)\\geq0, \\qquad \\int_{\\mathcal B}P(f)\\,df\\leq P_{\\mathrm{total}}.\\]\n\nHere \\(H(f)\\) is the channel frequency response, \\(P(f)\\) the allocated input power spectral density, and \\(N(f)\\) the noise power spectral density. The optimization is solved by water-filling, which allocates power preferentially to frequencies with more favorable gain-to-noise conditions. The flat-channel, white-noise case reduces to the Shannon–Hartley expression.\n\nOther channel models\n\nThe basic formula does not directly characterize every communication system:\n\n- Fading channels: varying channel gain requires distinctions such as ergodic capacity and outage capacity, depending on coding duration and channel knowledge.\n- Multiple-antenna channels: capacity depends on spatial channel structure and may involve matrices and eigenvalues rather than one scalar SNR.\n- Non-Gaussian noise: capacity depends on the full noise distribution, not solely on its power.\n- Peak-power or amplitude constraints: additional restrictions can change both capacity and the optimizing input distribution.\n- Short packets: finite block length and a specified error probability generally require rates below asymptotic capacity.\n- Multiuser interference: interference cannot always be treated as independent Gaussian noise; decoding strategy and network structure can change achievable rates.\n\nThe theorem is widely used as a benchmark for radio links, satellite communication, wired transmission, and optical systems where a suitable Gaussian-channel approximation applies. Its role is to establish a limit under explicit assumptions, rather than to predict practical throughput from bandwidth alone."
    }
  ],
  "links": [
    "channel-capacity",
    "additive-white-gaussian-noise",
    "information-theory",
    "normal-distribution",
    "signal-to-noise-ratio",
    "logarithm",
    "claude-shannon",
    "random-variable",
    "variance",
    "expected-value",
    "mutual-information",
    "differential-entropy",
    "sampling-theorem",
    "error-correcting-code",
    "matrix",
    "eigenvalues-and-eigenvectors"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}