E2 202, Fall 2022
Random Processes
Lectures
- 02 Aug 2022: Lecture-01 Sample and event space
- 04 Aug 2022: Lecture-02 Probability function
- 09 Aug 2022: Lecture-03 Independence of events
- 11 Aug 2022: Lecture-04 Random variables
- 16 Aug 2022: Lecture-05 Random vectors
- 28 Aug 2022: Lecture-06 Transformations of random vectors
- 23 Aug 2022: Lecture-07 Random processes
- 25 Aug 2022: Lecture-08 Expectation
- 30 Aug 2022: Lecture-09 Moments and L^p space
- 01 Sep 2022: Lecture-10 Correlation
- 06 Sep 2022: Lecture-11 Generating functions
- 08 Sep 2022: Lecture-12 Conditional expectation
- 13 Sep 2022: Lecture-13 Properties of conditional expectation
- 15 Sep 2022: Lecture-14 Almost sure convergence
- 20 Sep 2022: Lecture-15 $L^p$ convergence
- 22 Sep 2022: Lecture-16 Weak convergence
- 27 Sep 2022: Lecture-17 Tractable Random Processes
- 29 Sep 2022: Lecture-18 Stopping Times
- 04 Oct 2022: Lecture-19 Markov Chains
- 06 Oct 2022: Lecture-20 DTMC: Strong Markov Property
- 11 Oct 2022: Lecture-21 DTMC: Transient and recurrent states
- 13 Oct 2022: Lecture-22 DTMC: Communicating classes
- 18 Oct 2022: Lecture-23 DTMC: Invariant Distribution
- 20 Oct 2022: Lecture-24 Poisson point processes
- 25 Oct 2022: Lecture-25 Poisson point processes: Conditional distribution
- 27 Oct 2022: Lecture-26 Poisson point processes: Properties
- 01 Nov 2022: Lecture-27 Poisson processes on half-line
- 03 Nov 2022: Lecture-28 Poisson Processes: Compound
Homework
Homework discussions on Saturday 12:00 noon - 01:00 pm after Quiz/Exams.
- 04 Aug 2022: Homework-01
- 18 Aug 2022: Homework-02
- 01 Sep 2022: Homework-03
- 15 Sep 2022: Homework-04
- 29 Sep 2022: Homework-05
- 13 Oct 2022: Homework-06
- 27 Oct 2022: Homework-07
- 10 Nov 2022: Homework-08
Tutorials
Monday 05:00 pm - 06:30 pm
- 08 Aug 2022: Tutorial-01 Cardinality. Probability space. Limits of sets. Continuity of probability.
- 15 Aug 2022: Tutorial-02 Law of total probability. Independence of events. Conditional probability. Random variables.
- 22 Aug 2022: Tutorial-03 Random vectors. Transformation of random variables and random vectors.
- 29 Aug 2022: Tutorial-04 Random Processes. Expectation.
- 05 Sep 2022: Tutorial-05 Moments. Correlation. $L^p$ space. Inequalities.
- 12 Sep 2022: Tutorial-06 Generating functions. Conditional expectation.
- 19 Sep 2022: Tutorial-07 Almost sure convergence. Convergence in probability. Borel-Cantelli lemma.
- 24 Sep 2022: Tutorial-08 $L^p$ Convergence. Convergence in distribution. Problems on convergence of random variables.
- 26 Sep 2022: Tutorial-09 Law of large numbers. Central Limit theorem.
- 03 Oct 2022: Tutorial-10 Tractable random processes. Stopping times.
- 10 Oct 2022: Tutorial-11 Introduction to discrete time Markov chains.
- 17 Oct 2022: Tutorial-12 DTMC: Recurrent and transient states.
- 24 Oct 2022: Tutorial-13 DTMC: Communicating classes. Invariant distribution.
- 31 Oct 2022: Tutorial-14 Introduction to Poisson processes
- 07 Nov 2022: Tutorial-15 Thinning and superposition of Poisson processes
Tests
Quizzes: Saturday 11:30 am - 12:00 noon
Mid-terms: Saturday 11:00 am - 01:00 pm
Final: Wednesday 08:00 am - 12:00 noon
- 20 Aug 2022: Quiz-01
- 03 Sep 2022: Quiz-02
- 17 Sep 2022: Mid-term-01
- 01 Oct 2022: Quiz-03
- 15 Oct 2022: Quiz-04
- 29 Oct 2022: Mid-term-02
- 12 Nov 2022: Quiz-05
- 26 Nov 2022: Quiz-06
- 07 Dec 2022: Final
Grading Policy
Mid Term 1: 20
Mid Term 2: 20
Quizzes: 30
Final: 40
Class Participation: 10
Class participation is based on attendance and class interaction in lectures, tutorials, and homework discussions.
Course Syllabus
- Probability Theory:
- axioms, continuity of probability, independence, conditional probability.
- Random variables:
- distribution, transformation, expectation, conditional expectation, moment generating function, characteristic function
- Random vectors:
- joint distribution, conditional distribution, expectation, Gaussian random vectors.
- Convergence of random sequences:
- Borel-Cantelli Lemma, almost sure convergence, convergence in probability, convergence in $L^p$, weak convergence, laws of large numbers, central limit theorem, $L^1$ convergence theorems.
- Discrete time random processes:
-
ergodicity, strong ergodic theorem,definition, stationarity, correlation functions in linear systems,power spectral density.
-
- Structured random processes:
- Bernoulli processes, independent increment processes, discrete time Markov chains, recurrence analysis,
Foster’s theorem, reversible Markov chains,the Poisson process.
- Bernoulli processes, independent increment processes, discrete time Markov chains, recurrence analysis,
Course Description
Basic mathematical modeling is at the heart of engineering. In both electrical and computer engineering, uncertainty can be modeled by appropriate probabilistic objects. This foundational course will introduce students to basics of probability theory, random variables, and random sequences.
Teams Information
We will use Microsoft Teams for all the course related communication.
Please do not send any email regarding the course.
Students can signup for Microsoft Teams Random-Processes-2022 using their iisc.ac.in email.
To join the right team, please use the code 4hycyqw.
To be on the course team, you have to be formally registered for the course.
If you registered recently and wish to join the course team, please send a direct message on the Teams.
Instructor
Parimal Parag
Office: EC 2.17
Hours: By appointment.
Time and Location
Classroom: Auditorium 1, MP 20, ECE MP Building.
Hours: Tue/Thu 11:30am - 01:00pm.
Tutorial: Mon 05:00 pm - 06:30 pm.
Quizzes: Sat 11:00 am - 12:00 noon.
Mid-terms: Sat 11:00 am - 01:00 pm.
HW Discussions: Sat 12:00 noon - 01:00 pm.
Teaching Assistants
Avik Kar
Office: MP 221
Hours: By appointment.
Aniket Mukherjee
Office: ESE 316
Hours: By appointment.
Moonmoon Mohanty
Office: EC 2.16
Hours: By appointment.
Daniyal Khan
Office:
Hours: By appointment.
Aishwarya Anand
Office:
Hours: By appointment.
Shankul Saini
Office:
Hours: By appointment.
Duda Gayathri Reddy
Office:
Hours: By appointment.
Sriram G
Office:
Hours: By appointment.
Textbooks
Probability and Random Processes, Geoffrey Grimmett and David Stirzaker, 3rd edition, 2001.
Probability and Random Processes: With Applications to Signal Processing and Communications, Scott L. Miller and Donald G. Childers, 2nd Edition, 2012.
Random Processes for Engineers, Bruce Hajek, 2014.
Introduction to Probability, Dimitri P. Bertsekas and John N. Tsitsiklis, 2nd edition, 2008.
Discrete Event Stochastic Processes, Anurag Kumar.