Understanding the Shannon-Hartley Theorem
The Shannon-Hartley Theorem establishes the absolute theoretical upper bound for the maximum rate of error-free information transfer through a continuous-time communications channel corrupted by Additive White Gaussian Noise (AWGN).
Theorem & Mathematical Derivation
Channel capacity ($C$ in bits per second) is expressed as a function of operational bandwidth ($B$ in Hertz) and signal-to-noise ratio ($S/N$):
- $$C = B \log_2 \left(1 + \frac{S}{N}\right)$$
Dividing capacity by bandwidth yields the theoretical maximum Spectral Efficiency ($\eta$) in units of bits per second per Hertz ($\text{bits/s/Hz}$):
- $$\eta = \frac{C}{B} = \log_2 \left(1 + \text{SNR}_{\text{linear}}\right)$$
The Ultimate Shannon Limit ($E_b/N_0 = -1.6\ \text{dB}$)
As bandwidth approaches infinity ($B \to \infty$), channel capacity does not grow without bound. Instead, it asymptotically approaches a theoretical minimum normalized energy per bit required for reliable transmission:
- $$\left(\frac{E_b}{N_0}\right)_{\text{min}} = \ln(2) \approx 0.693 \equiv -1.59\ \text{dB}$$
No real-world digital communication system can achieve error-free transmission when operating below this fundamental limit ($E_b/N_0 < -1.59\ \text{dB}$).