Materials to the course of Information theory, Univ Montpellier, autumn 2019.
Homework:
- homework to lecture on Sep 10
- homework to lecture on Sep 17
- homework to lecture on Sep 24
- homework to lecture on Oct 1
- homework to lecture on Oct 8
(see a solution for exercise 1)
- homework to lecture on Dec 3
- homework to lecture on Dec 10
- more exercises for the last 3 weeks of the course
For more exercises see chapters 1, 2, 7 in Shen-Vereshchagin-Uspensky book.
Bibliography for the first 5 weeks of the course — classical information theory:
In English:
- T.M. Cover and J.A. Thomas. Elements of information theory. John Wiley and Sons. 2012.
- D MacKay. Information Theory, Inference, and Learning Algorithms. Cambridge University Press, 2003.
In French:
- Y. Ollivier. Aspects de l'entropie en mathématiques. 2002
- N. Sendrier. Introduction à la théorie de l'information. 2007
In Russian:
- Н.К. Верещагин, Е.В. Щепин. Информация, кодирование и предсказание. МЦНМО, 2012.
- А. Яглом, И. Яглом. Вероятность и информация. Наука, 1973.
Bibliography for the last 3 weeks of the course — Kolmogorov complexity and communication complexity:
In English:
- T.M. Cover and J.A. Thomas. Elements of information theory. John Wiley and Sons. 2012.
- A. Shen, V. Uspensky, and N. Vereshchagin.
Kolmogorov complexity and algorithmic randomness. Vol. 220. American Mathematical Soc., 2017.
- E. Kushilevitz and N. Nisan. Communication Complexity. CambridgeUniversity Press, 1996, NY, USA.
In French:
- D. Durand, A. Zvonkin, Complexité de Kolmogorov.
In Russian:
- Н.К. Верещагин, Е.В. Щепин. Информация, кодирование и предсказание. МЦНМО, 2012.
- В. Успенский, А. Шень, Н. Верещагин.
Колмогоровская сложность и алгоритмическая случайность. 2017.