DIT UNIVERSITY, DEHRADUN

Semester I 2017 2018

Course Handout
Date: 02-07-2017
The following is the detailed course handout for the course mentioned below.
Course No. : DCC020 (4 0 0)
Course Title : Information Theory and coding
Course Faculty : Dr. Narendra Kumar
Course Coordinator : Dr. Narendra Kumar
Scope and Objective of the Course:
To deeply understand the mathematics of Information Theory and its physical meaning
Relate the joint, conditional, and marginal entropies of variables in terms of their coupled
probabilities
To understand various Source coding techniques
Construct efficient codes for data on imperfect communication channels
To provide an overview on some basic tools as well as several advanced topics in lossy and
lossless source coding. From both the theoretic and practical aspects students are encouraged to
propose research oriented projects and investigate them.
Understand and explain limits in human perception that are exploited by lossy compression
techniques
Provide a good overview of the principles and characteristics of several widely-used compression
techniques and standards for image and video signals
To understand various channel coding techniques
Can apply the knowledge to real problems in communication application

Text book [TB]:

1. R Bose, Information Theory, Coding and Cryptography, TMH 2007

Reference books [RB]:

i. . Fred Halsall ,Multimedia Communications: Applications, Networks, protocols and
Standards, Perason Education Asia, 2002 .
ii. K Sayood, Introduction to Data Compression 3/e, Elsevier 2006
iii. S Gravano, Introduction to Error Control Codes, Oxford University Press 2007
iv. Amitabha Bhattacharya, Digital Communication, TMH 2006

Course Plan / Schedule:

Sl.# Learning objectives Topics to be covered Chapter No No. of
[TB] lectures
1 Information Theory Information, Entropy Joint Entropy, Conditional 1.1 to 1.5 6
Entropy ,Mutual information, Information rate,
classification of codes
Kraft McMillan inequality, Source coding theorem.
2 Discrete memory less BSC, BEC, Channel capacity, Shannon limit. 2.1 to 2.6 4
channels
3 Source Coding: Text Types of codes, Huffman Coding Extended 1.5 to 6
Huffman Coding Adaptive Huffman Coding, 1.10
Arithmetic Coding LZ77 algorithm, LZ78
algorithm, Run length Encoding
4 Predictive Coding Predictive Coding, Burrows-Wheeler Transform 1.15 to 2
based predictive coding. 1.16
5 Source Coding: Image Image and Video Formats GIF, TIFF, SIF, CIF, 1.11 4
QCIF, Image compression: JPEG, JPEG-2000, to1.14
6 Source Coding: Video Video Compression: Principles of I-B-P frames, Lecture 8
Motion estimation, Motion compensation, H.261, Notes
H.263, H.264, MPEG standard, Distributed Video
Coding

7 Error Control Coding: Block codes, Hamming weight, Hamming distance, 3.1 to 8
Block Codes Minimum distance decoding - Single parity codes, 3.10

1
 Hamming codes, Repetition codes, linear block
codes

8 Error Control Coding: Convolutional codes code tree, trellis, state 6.1 to 7
Convolutional Codes diagram, Encoding, Decoding, Principle of Turbo 6.11
coding

Total 45

Evaluation scheme:
EC Evaluation Components Duration Total Weightage %
N0
1 Quizzes (2) 10 Minutes each 5
2 Mid Term Exam 2 Hours 30
3 Class Tests (3) 15 Minutes each 5
4 Assignments - 5
5 End TermExam 3 Hours 55
TOTAL 100

General Instructions, Attendance etc:

Please refer to Student Handbook

Notices:
All notices will be displayed on the First year Notice Board.

Dr. Narendra Kumar

Instructor In- Charge

Instructors Contact Details:

Dr. Narendra Kumar, Assistant Professor, Room No.219 Vedanta, Contact Tel. No. +919917628340
E-mail: narendra.kumar@dituniversity.edu.in