Click here for important class announcements.

[ Announcements | Lectures | Homework | Course Outline | References ]

---

Instructor

Navin Kashyap
Office: SP 2.17

Teaching Assistants

M. Ashok Kumar
Office: SP 1.11

Lectures

Tuesdays & Thursdays, 3:30 - 5:00pm
Location: ECE 1.08

Discussion Sessions

Fridays, 6:00 - 7:30pm
Location: ECE 1.08

Homework Assignments

Homework assignments will be posted on this website once every two weeks. Students are expected to solve all homework problems. However, only undergraduate students are required to submit their homework solutions, which will be graded. Discussion sessions will be held for the purpose of helping students solve homework problems.

• Homework assignment 1
  Discussion session: Aug. 15. Quiz: Aug. 22.
• Homework assignment 2
  Discussion session: Aug. 30. Quiz: Sept. 5.
• Homework assignment 3
  Discussion session: Sept. 12. Quiz: Sept. 19.
• Homework assignment 4
  Discussion session: Sept. 26. Quiz: Oct. 7.
• Homework assignment 5
  Discussion session: Oct. 17. Quiz: Oct. 24.
• Homework assignment 6
  Discussion session: Oct. 31. Quiz: Nov. 7.
• Homework assignment 7
  Discussion session: Nov. 14. Quiz: Nov. 21.
• Homework assignment 8
  Discussion session: Nov. 28. No quiz.

Quizzes

Quizzes based on the homework assignments will be held once in two weeks, at the start of the discussion sessions. Quizzes are mandatory for graduate students, and optional for undergraduates.

Exams

There will be one midterm exam and one final exam. The midterm was held in class on Thursday, October 9, 3:30-5:00pm.
The final exam has been scheduled for Wednesday, December 3, 2:00-5:00pm, in ECE 1.08. See announcements page for additional information.

Grading

The course grade will be based on the following: 20% weightage assigned to homeworks/quizzes, 30% to the midterm exam, and 50% to the final exam.

Course Outline

Entropy, mutual information, source coding, channel capacity, channel coding theorems, differential entropy, Gaussian channel, rate-distortion theory, brief overview of network information theory.

References

• T.M. Cover and J.A. Thomas, Elements of Information Theory, 2nd ed., Wiley, 2006.
  (The second edition is now available from Tata Book House, IISc, at an affordable price. The second edition contains a more detailed exposition of network information theory.)
• I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems, 2nd ed., Cambridge University Press, 2011
  (The first edition was published in 1981 by Academic Press. The new, second edition has been updated considerably.)
• R.G. Gallager, Information Theory and Reliable Communication, John Wiley & Sons, 1968.
• R.W. Yeung, A First Course in Information Theory, Springer, 2002.

---

[ Announcements | Lectures | Homework | Course Outline | References ]

---