Unit I Introduction : Information Theory, Information and entropy, joint and conditional entropy, differential entropy, relative entropy, mutual information, relationship between entropy and mutual information.
Unit II Source coding: Shannon’s source coding theorem, Huffman coding, Shannon Fano coding. Channel Coding Channel capacity, binary symmetric channel, binary erasure channel, Shannon’s channel coding theorem.
Unit III Linear Block Codes: Definition, properties, matrix description of linear block codes, generator and parity check matrix, encoding of linear block codes, decoding of linear block codes, syndrome decoding, standard array, co-sets, perfect codes, systematic block code, Hamming code.
Unit IV Cyclic Codes: Introduction, properties of cyclic codes, polynomials and division algorithm, and decoding of cyclic codes, matrix description of cyclic codes, burst error correction, cyclic redundancy check. Circuit implementation of cyclic codes.
Unit V Convolution Codes: Introduction, tree codes and trellis codes, polynomial description of convolution codes, distance notation, generating function, matrix description, viterbi decoding.
Unit II Source coding: Shannon’s source coding theorem, Huffman coding, Shannon Fano coding. Channel Coding Channel capacity, binary symmetric channel, binary erasure channel, Shannon’s channel coding theorem.
Unit III Linear Block Codes: Definition, properties, matrix description of linear block codes, generator and parity check matrix, encoding of linear block codes, decoding of linear block codes, syndrome decoding, standard array, co-sets, perfect codes, systematic block code, Hamming code.
Unit IV Cyclic Codes: Introduction, properties of cyclic codes, polynomials and division algorithm, and decoding of cyclic codes, matrix description of cyclic codes, burst error correction, cyclic redundancy check. Circuit implementation of cyclic codes.
Unit V Convolution Codes: Introduction, tree codes and trellis codes, polynomial description of convolution codes, distance notation, generating function, matrix description, viterbi decoding.
No comments:
Post a Comment