Mauro Barni
University of Siena - Dipartimento di Ingegneria dell'Informazione e Scienze Matematiche

Course Type

Type B

Calendar

dal 15 al 19 Settembre
10:00-13:00
Aula 101

Room

Program

1. Information Theory in a nutshell.
Entropy as a measure of information.
Main properties of Entropy.
Conditional Entropy and mutual information.
Kullback-Leibler distance

2. The method of types
Definitions.
Main properties.
The law of large numbers.
Source coding.

3. IT and large deviation Theory
Sanov Theorem.
Conditional Limit theorem.
Examples.

4. IT and Hypothesis testing
Problem definition.
Neyman-Pearson Theorem.
Error exponents.
Stein's Lemma.
Chernoff bound.

5. Application to adversarial signal processing
The Source identification game with known sources.
Indistinguishability region.
Security Margin.
Source identification with training data.
Distributed hypothesis testing in adversarial setup.