E2 201 : Information Theory
August 2011
Instructor
Lecture Hours
Mondays and Wednesdays : 8:30 - 10:00 AM
Fridays : 8:30 - 10:00 AM (Homework discussion sessions)
Location
Teaching Assistants
- Nidhin Koshy Vaidhiyan
- Akhil P. T.
Course syllabus
Entropy, mutual information, source coding, hypothesis testing, channel capacity, channel coding theorems, differential entropy, Gaussian channel, Kolmogorov complexity, rate-distortion theory, brief overview of network information theory.
Course Grade
- 20/100 : Quizzes on homeworks (fortnightly, Fridays 8:30 - 9:00 AM, followed by a discussion)
- 30/100 : Mid-term (1.5 hours) Friday 30 September 2011, 8:30 - 10:00 AM
- 50/100 : Final (3 hours) Thursday 01 December 2011, 9:00 AM - 12:00 noon
Homeworks
Fortnightly homeworks.
- Problem Set 1 Discussion on Friday 19 August 2011, Quiz on Friday 26 August 2011
- Problem Set 2 Discussion on Friday 09 September 2011, Quiz on Friday 16 September 2011
- Problem Set 3 Discussion on Monday 26 September 2011, Mid-term on Friday 30 September 2011
- Problem Set 4 Discussion on Wednesday 28 September 2011, Mid-term on Friday 30 September 2011
- Discussion of mid-term examination questions on Monday 03 October 2011
- Problem Set 5 Discussion on Friday 14 October 2011, Quiz on Friday 21 October 2011
- Problem Set 6 Discussion on Friday 28 October 2011, Quiz on Friday 04 November 2011
- Problem Set 7 Discussion on Friday 11 November 2011, Quiz on Friday 18 November 2011
- Problem Set 8 Discussion on Friday 18 November 2011
- Problem Set 9 Discussion on Friday 25 November 2011
Reference Texts
- Cover, T.M., and Thomas J.A., Elements of Information Theory, 2nd Edition, John Wiley and Sons, 2006.
An affordable older edition is available from Tata Book House, IISc, with 20% discount for IISc students.
- Parthasarathy, K.R., Coding Theorems of Classical and Quantum Information Theory, TRIM no. 45, Hindustan Book Agency, 2007.
Available at an affordable price at Tata Book House, IISc, with 20% discount for IISc students.