Information Theory and Coding: Information, Source Coding and Channel Coding

Various measures of information are discussed in first chapter. Information rate, entropy and mark off models are presented.Second and third chapter deals with source coding. Shannon’s encoding algorithm, discrete communication channels, mutual information, Shannon’s first theorem are also presented. Huffman coding and Shannon-Fano coding is also discussed.Continuous channels are discussed in fourth chapter. Channel coding theorem and channel capacity theorems are also presented.Block codes are discussed in chapter fifth, sixth and seventh. Linear block codes, Hamming codes, syndrome decoding is presented in detail. Structure and properties of cyclic codes, encoding and syndrome decoding for cyclic codes is also discussed. Additional cyclic codes such as RS codes, Golay codes, burst error correction is also discussed.Last chapter presents convolutional codes. Time domain, transform domain approach, code tree, code trellis, state diagram, Viterbi decoding is discussed in detail.