EE-850 Information Theory & Coding

Fall 2011 Class MS Electrical Engineering (Telecom) Pakistan Navy Engineering College National University of Sciences & Technology

Introduction
Information Theory is the branch of knowledge which tries to determine answers to questions like: What is the information carrying capacity of a communication channel? How many bits are required at a minimum to represent a certain type of information? How secure is an encryption algorithm? Information is a loaded word information means many different things in different contexts. Internet is now a part and parcel of our life: packets carry information across the globe. Cellular phones are ubiquitous: we can't think of life without them. DVD, Flash, Hard Disk: allow us to carry tremendous amounts of information. Email: has changed the nature of business and personal communication. Instant Messaging: has made presence awareness and collaboration real-time. Even in the military arena terms like Information Warfare, Psychological Operations, Network Centric Warfare and Situational Awareness are all the contexts in which information is playing a critical role. In this course we shall remain confined to the mathematical and engineering aspects of information measurement and representation. We shall understand the principles behind theoretical limits on compression, error control and encryption coding techniques. The list of topics to be covered is given below: Introduction to Information Theory Mathematical Background Entropy and Shannon's Measure of Information Huffman Coding Lempel-Ziv Coding Deflate Arithmetic Coding Run Length Encoding JPEG Image Compression Speex Audio Codec Finite Fields Complexity Theory Error Control Principles Parity CRC Hamming Codes Reed Solomon Codes RSA Diffie-Hellman Elliptic Curve Cryptography Data Encryption Standard Advanced Encryption Standard

Textbook
Information Theory Coding & Cryptography Ranjan Bose Tata McGraw-Hill Publishing Company

EE-850 Information Theory & Coding Course Outline

Page 1 of 2

Class Timings
Monday: 18:00-21:00, PG-008 or PGPC Lab, Center for Postgraduate Studies

Grading Policy
Homeworks Quizzes Hourly Tests Final Exam 10% 10% 30% 50%

Quizzes shall be surprise and frequent. Homeworks will be due at the beginning of the class. No late homework will be accepted. Final course grades shall be assigned based on the relative grading system in practice at Pakistan Navy Engineering College.

Hourly Test Schedule

Test No. 1. 2. 3. Day Monday Monday Monday Date October 24, 2011 November 28, 2011 December 19, 2011

Plagiarism Policy
All work assigned to students is to be undertaken and submitted in individual capacity. Any evidence of plagiarism will be severely dealt with as per NUST Policy.

About the Instructor

Dr. Athar Mahboob is an Associate Professor at the National University of Sciences & Technology, Pakistan. Dr. Athar Mahboob obtained a PhD in Electrical Engineering from National University of Sciences & Technology, Pakistan in 2005. Earlier, he had obtained BS and MS degrees in Electrical Engineering both from Florida State University, USA (1988-1996). Dr. Athar Mahboob has over 15 years of teaching and research experience in various prestigious universities of Pakistan. Dr. Athar Mahboob is a specialist in implementing Enterprise Information Services using Linux, Information Security and Cryptology, Computer Networks and Internetworking using TCP/IP Protocols, Digital Systems Design and Computer Architectures. Dr. Athar Mahboob's Ph. D. research was focused on Efficient Hardware and Software Implementations of Elliptic Curve Cryptography an area in which he has obtained several international publications. In addition to teaching and research, over the last 15 years Dr. Athar Mahboob has performed IT Consultancy assignments for many reputable organizations in the public and private sectors. His consultancy assignments have included PTCL, Pakistan Security Printing Corporation, Peoples' Steel Mills, Institute of Bankers, Pakistan, EFU General Insurance and many others. Being fully involved with both industrial and academic environments allows Dr. Athar Mahboob to educate, train and mentor his students in real-world problem solving.

Contacting the Instructor

Dr. Athar Mahboob, Head of Computer Science Department Office: PNEC Data Center Email: athar@pnec.edu.pk Cell: 0333-2344105 Tel: 99240051 Office Hours: Monday 2:30-4:30. Other times are by appointment.

EE-850 Information Theory & Coding Course Outline

Page 2 of 2