**Excerpt from Signals - The Science of Telecommunications**

__Communication Channel Capacity__

In his mathematical theory of communication, Claude Shannon showed that even a noisy communication channel has a channel capacity measured in bits per second. Consider a communication channel of bandwidth

Hz. Suppose that the power received over the channel is a signal powerBand a noise powerPfrom noise somehow added during transmission and amplification. The channel capacityNin bits per second is:CC = B log_{2}(1 + S / N)The equation shows the advantage of using a broad bandwidth to transmit messages.

Because noise is proportional to bandwidth, the thermal, or Johnson, noise power and bandwidth are related by the equation:

N =kTBwhere

is Boltzmann's constant (1.38 * 10k^{-23}) andis noise temperature in kelvins.TIf

is all the noise that is added to the signal:NC = B log_{2}(1 + S /kTB)Note in this equation the bandwidth

appears twice. For a given signal power, asBincreases the channel capacity increases. Thus, if possible it is better toB.use more rather than less bandwidth in transmitting a signal with a given powerAs the bandwidth

is made larger and larger, the channel capacity approaches the limiting value:BC = BS /kT ln_{2}This equation shows that the energy necessary to transmit one bit of information can never be less than

.kT ln_{2}= 0.693kT jouleThat limit is approached most closely in painstakingly designed communication systems for interplanetary missions. To gain an idea of the energy involved, consider that the electricity used in lighting homes is measured by the kilowatt-hour. A kilowatt-hour is equal to 3.6 * 10

^{6}joules. Boltzmann's constant is equal to 1.38 * 10^{-23}joules per degree. Room temperature is about 293 K. At this temperature,kT ln_{2}= 1.23 * 10^{-27}kilowatt-hour per bit (or a decimal point followed by 26 zeros followed by 123). In principle, it doesn't take much power to transmit a bit of information. In practice it takes somewhat more - a few times more in well designed systems.The foregoing calculations are "classical"; they were derived without taking into account the quantum nature of electromagnetic radiation. I was surprised to find, some years ago, that

kT ln_{2}joules per bitisthe correct quantum mechanical result, but is is almost impossible to approach closely in signaling with light. Still, workers at Caltech's Jet Propulsion Laboratory have attained signaling rates of several bits per photon.

__Notes__

log

_{2}is a log to the base 2, and for any number X:log_{2}(X) = log_{10}(X) / log_{10}(2)Another overview of Shannon's theorem.