Ricerca di contatti, progetti,
corsi e pubblicazioni

Probability, Statistics and Information Theory

Descrizione

We treat the basic notions of discrete probability theory: Probability spaces, the probability function, random variables, expectation value, variance and covariance. Of central importance are the limit theorems such as the weak law of large numbers and the central limit theorem. These establish the link to statistics: In order to obtain a significant statement from a random sample, what is the necessary size of the sample? We discuss estimators and tests. Also based of the notions of probability, we discuss the basics of information theory such as entropy, conditional entropy, and mutual information. We briefly look into the central results of coding theory, such as source and channel coding. These latter are of paramount importance, e.g., for data compression as well as (wireless) communication.

REFERENCES:

  • Elements of information theory [Archivio elettronico] / Thomas M. Cover, Joy A. Thomas. - Hoboken, N.J. : Wiley-Interscience, 2006.
  • An introduction to probability theory and its applications / William Feller. -  New York [etc.] : J. Wiley, 1968-1971 .

Persone

 

Wolf S.

Docente titolare del corso

Ebbe H.

Assistente

Hansen A.

Assistente

Salwey L. B.

Assistente

Informazioni aggiuntive

Semestre
Autunnale
Anno accademico
2014-2015
ECTS
6
Riferimenti bibliografici
Offerta formativa
Bachelor of Science in Informatics, Corso di base, Corso, 2° anno
Master of Science in Management and Informatics, Management track, 2° anno