E2 201 : Information Theory

Instructor

Rajesh Sundaresan

Lecture Hours

Tuesdays and Thursdays: 14:00 - 15:30 hrs
First class: Thursday 14:00 hrs, 01 January 2026, MP20

Location

MP20, Microelectronics and Photonics Building of the ECE Department

Office Hours and Tutorial Sessions

Office hour: by appointment
Location: MP326

Tutorials: Saturdays : 14:00 - 15:30 hrs handled by TAs
Location: MP20

Teaching Assistants

• Shivpratap Singh Rathore
  

Course syllabus

Entropy, mutual information, data compression, channel capacity, differential entropy, Gaussian channel, other topics as decided by the instructor.

Course Grade

• 0/100 : Practice test (1.5 hours) Thursday 22 January 2026, 14:00 - 15:30 hrs
  
• 25/100 : Mid-term 1 (1.5 hours) Thursday 05 February 2026, 14:00 - 15:30 hrs
  
• 25/100 : Mid-term 2 (1.5 hours) Thursday 12 March 2026, 14:00 - 15:30 hrs
  
• 50/100 : Final (3 hours) TBA, as per SCC announcement
  

Tutorials

• Problem Set 1, discussion on Saturday 10 January 2026.
• Problem Set 2, discussion on Saturday 17 January 2026.
• Discussion of practice test on Saturday 24 January 2026.
• Problem Set 3, discussion on Saturday 31 January 2026.
• Problem Set 4, discussion on Saturday 07 February 2026.
• Problem Set 5
• Problem Set 6
• Problem Set 7
• Problem Set 8
• Problem Set 9
• Problem Set 10

Reference Texts

• Cover, T.M., and Thomas J.A., Elements of Information Theory, 2nd Edition, John Wiley and Sons, 2006.