SUBJECT

Title

Introduction to information theory

Type of instruction

lecture

Level

master

Part of degree program
Credits

3

Recommended in

Semesters 1-4

Typically offered in

Autumn/Spring semester

Course description

Source coding via variable length codes and block codes. Entropy and its formal properties. Information divergence and its properties. Types and typical sequences. Concept of noisy channel, channel coding theorems. Channel capacity and its computation. Source and channel coding via linear codes. Multi-user communication systems: separate coding of correlated sources, multiple access channels.

Readings
  • Csiszár – Körner: Information Theory: Coding Theorems for Discrete Memoryless Systems. Akadémiai Kiadó, 1981.
  • Cover – Thomas: Elements of  Information Theory. Wiley, 1991.