Print and PDF Options

SYSC 5506 [0.5 credit] (ELG 5170) Information Theory


Measure of information: entropy, relative entrophy, mutual information, asymptotic equipartition property, entropy rates for stochastic processes; data compression: Huffman code, arithmetic coding; channel capacity: random coding bound, reliability function, Blahut-Arimoto algorithm, Gaussian channels, coloured Gaussian noise and 'water-filling'; rate distortion theory; network information theory.
Precludes additional credit for EACJ 5501 (ELG 5170).
Prerequisite(s): SYSC 5503 (ELG 6153) or EACJ 5109 (ELG 5119) or equivalent.