Materials to the course of Information theory, Univ Montpellier, autumn 2020.

If you need a consultation (online or offline) before the exam, please contact me by March 17.

The exam is rescheduled on March 25. If you need an online consultation before the exam, please contact me by mail by March 22.

Program of the course

Lecture notes:

Homework:

Preparation for the final exam: use all exercises of the course, especially these, these, and these ones.

Bibliography for the first 5 weeks of the course — classical information theory:

In English:

  1. T.M. Cover and J.A. Thomas. Elements of information theory. John Wiley and Sons. 2012.
  2. D. MacKay. Information Theory, Inference, and Learning Algorithms. Cambridge University Press, 2003.
  3. A. Shen, V. Uspensky, and N. Vereshchagin. Kolmogorov complexity and algorithmic randomness. Vol. 220. American Mathematical Soc., 2017.

In French:

  1. Y. Ollivier. Aspects de l'entropie en mathématiques. 2002
  2. N. Sendrier. Introduction à la théorie de l'information. 2007
  3. D. Durand, A. Zvonkin, Complexité de Kolmogorov.

In Russian:

  1. Н.К. Верещагин, Е.В. Щепин. Информация, кодирование и предсказание. МЦНМО, 2012.
  2. А. Яглом, И. Яглом. Вероятность и информация. Наука, 1973.

Supplementary bibliography (original papers):

  1. C. E. Shannon, A mathematical theory of communication. The Bell system technical journal, 27(3), 379-423. (1948)
  2. P. L. Tchebychef. Des valeurs moyennes. Journal de mathématiques pures et appliquées 2e série, tome 12 (1867), p. 177-184.
  3. I.-J. Benaymé. Considérations à l’appui de la découverte de Laplace sur la loi deprobabilité dans la méthode des moindres carrés. Journal de mathématiques pures et appliquées 2e série, tome 12 (1867), p. 158-176.