Materials to the course of Information theory, Univ Montpellier, autumn 2020.
If you need a consultation (online or offline) before the exam, please
contact me
by March 17.
The exam is rescheduled on March 25.
If you need an online consultation before the exam, please
contact me by mail
by March 22.
Lecture notes:
Homework:
Preparation for the final exam: use all exercises of the course, especially
these, these, and these ones.
Bibliography for the first 5 weeks of the course — classical information theory:
In English:
- T.M. Cover and J.A. Thomas. Elements of information theory. John Wiley and Sons. 2012.
- D. MacKay. Information Theory, Inference, and Learning Algorithms. Cambridge University Press, 2003.
- A. Shen, V. Uspensky, and N. Vereshchagin.
Kolmogorov complexity and algorithmic randomness.
Vol. 220. American Mathematical Soc., 2017.
In French:
- Y. Ollivier. Aspects de l'entropie en mathématiques. 2002
- N. Sendrier. Introduction à la théorie de l'information. 2007
- D. Durand, A. Zvonkin,
Complexité de Kolmogorov.
In Russian:
- Н.К. Верещагин, Е.В. Щепин. Информация, кодирование и предсказание. МЦНМО, 2012.
- А. Яглом, И. Яглом. Вероятность и информация. Наука, 1973.
Supplementary bibliography (original papers):
-
C. E. Shannon, A mathematical theory of communication. The Bell system technical journal, 27(3), 379-423. (1948)
-
P. L. Tchebychef. Des valeurs moyennes. Journal de mathématiques pures et appliquées 2e série, tome 12 (1867), p. 177-184.
-
I.-J. Benaymé. Considérations à l’appui de la découverte de Laplace sur la loi deprobabilité dans la méthode des moindres carrés. Journal de mathématiques pures et appliquées 2e série, tome 12 (1867), p. 158-176.