The concepts of source, channel, rate of transmission of information. Entropy and mutual information. The noiseless coding theorem. Noisy channels, the coding theorem for finite state zero memory channels. Channel capacity. Error bounds. Parity check codes. Source encoding.