E2 201 : Information Theory
January 2026
Instructor
Lecture Hours
Tuesdays and Thursdays: 14:00 - 15:30 hrs
First class: Thursday 14:00 hrs, 01 January 2026, MP20
Location
MP20, Microelectronics and Photonics Building of the ECE Department
Office Hours and Tutorial Sessions
Office hour: by appointment
Location: MP326
Tutorials: Saturdays : 14:00 - 15:30 hrs handled by TAs
Location: MP20
Teaching Assistants
Course syllabus
Entropy, mutual information, data compression, channel capacity, differential entropy, Gaussian channel, other topics as decided by the instructor.
Course Grade
- 0/100 : Practice test (1.5 hours) Thursday 22 January 2026, 14:00 - 15:30 hrs
- 25/100 : Mid-term 1 (1.5 hours) Thursday 05 February 2026, 14:00 - 15:30 hrs
- 25/100 : Mid-term 2 (1.5 hours) Thursday 12 March 2026, 14:00 - 15:30 hrs
- 50/100 : Final (3 hours) Monday 27 April 2026, 14:00 - 17:00 hrs, as per SCC announcement
Tutorials
- Problem Set 1, discussion on Saturday 10 January 2026.
- Problem Set 2, discussion on Saturday 17 January 2026.
- Discussion of practice test on Saturday 24 January 2026.
- Problem Set 3, discussion on Saturday 31 January 2026.
- Problem Set 4, discussion on Saturday 07, 14 February 2026.
- Problem Set 5, discussion on Saturday 21 February 2026.
- Problem Set 6, discussion on Saturday 28 February 2026.
- Problem Set 7, discussion on Tuesday 10 March 2026.
- Problem Set 8, discussion on Saturday 28 March 2026.
- Problem Set 9, discussion on Saturday 04/11 April 2026.
- Problem Set 10, discussion on Saturday 18 April 2026.
Reference Texts
- Cover, T.M., and Thomas J.A., Elements of Information Theory, 2nd Edition, John Wiley and Sons, 2006.