SUBJECT
Title
Introduction to information theory
Type of instruction
lecture
Level
master
Faculty
Part of degree program
Credits
3
Recommended in
Semesters 1-4
Typically offered in
Autumn/Spring semester
Course description
Source coding via variable length codes and block codes. Entropy and its formal properties. Information divergence and its properties. Types and typical sequences. Concept of noisy channel, channel coding theorems. Channel capacity and its computation. Source and channel coding via linear codes. Multi-user communication systems: separate coding of correlated sources, multiple access channels.
Readings
- Csiszár – Körner: Information Theory: Coding Theorems for Discrete Memoryless Systems. Akadémiai Kiadó, 1981.
- Cover – Thomas: Elements of Information Theory. Wiley, 1991.