Week of August 29
| Tuesday | Introduction, history and preview Lecture notes are posted on Oncourse. |
| Thursday | Review of basic probability theory HW 1 is posted on Oncourse. Lecture notes are posted on Oncourse. |
Week of September 5
| Tuesday | Random variables, entropy Lecture notes are posted on Oncourse. |
| Thursday | Joint entropy and conditional entropy Lecture notes are posted on Oncourse. Groups are formed! |
Week of September 12
| Tuesday | Relative entropy and mutual information Lecture notes are posted on Oncourse. |
| Thursday | Chain rules and some inequalities Lecture notes are posted on Oncourse. HW 2 is posted on Oncourse. |
Week of September 19
| Tuesday | More inequalities Lecture notes are posted on Oncourse. |
| Thursday | Convergence theorems Lecture notes are posted on Oncourse. |
Week of September 26
| Tuesday | Asymptotic equipartition property and typical sets
Lecture notes are posted on Oncourse. | Thursday | Entropy rates of Markov chains and HMMs Lecture notes are posted on Oncourse. HW 3 is posted on Oncourse. |
Week of October 3
| Tuesday | Entropy rates of random processes continued Lecture notes are posted on Oncourse. |
| Thursday | Entropy rates for HMM
Deadline to get your study paper approved. Lecture notes are posted on Oncourse. |
Week of October 10
| Tuesday | Data compression I Lecture notes are posted on Oncourse. |
| Thursday | Data compression II Lecture notes are posted on Oncourse. HW 4 is posted on Oncourse. |
Week of October 17
| Tuesday | Data compression III Lecture notes are posted on Oncourse. |
| Thursday | Midterm |
Week of October 24
| Tuesday | Data compression IV Lecture notes are posted on Oncourse. |
| Thursday | Channel capacity I HW 5 is posted on Oncourse. Lecture notes are posted on Oncourse. |
Week of October 31
| Tuesday | Channel capacity II Lecture notes are posted on Oncourse. |
| Thursday | Channel capacity III Lecture notes are posted on Oncourse. |
Week of November 7
| Tuesday | Information theory and statistics I, method of types Lecture notes are posted on Oncourse. |
| Thursday | Information theory and statistics II
No lecture notes: we solved the midterm problems. Deadline for your critical review. |
Week of November 14
| Tuesday | Information theory and statistics III, upper and lower bounds Lecture notes are posted on Oncourse. |
| Thursday | Information theory and statistics IV, Law of large numbers | Lecture notes are posted on Oncourse.
Week of November 21
| Tuesday | Information theory and statistics V, Large deviation theory Lecture notes are posted on Oncourse. |
| Thursday | Thanksgiving Break |
Week of November 28
| Tuesday | Fisher information |
| Thursday | Cramer-Rao inequality |
Week of December 5
| Tuesday | Universal source coding I |
| Thursday | Universal source coding II Deadline for your grant proposal. |