456-0120/01 – Theory of Information and Coding (TIK)

Theoretical basics of discipline "Theory of Information and Coding" are formed in the two Shannon theorems. The first theorem on coding without the error occurring forms the conditions of data compression. The key variable is entropy of source of messages or in other words the amount of redundancy in the message or data set. Entropy is a criterion for decision of the compression type. The compression will be without lost of information, if the value of entropy is not exceed, and it is with the lost of information if it is exceed. The second theorem is called on coding with the error occurring. This theorem is formed as conditions of error-control coding, which differ in the way of encoding and decoding calculation. The error occurring in the records is defined by conditions of physical properties of memory medium. The explanations are defined in general mathematical form, and it is abstracted from the fact, if the medium is the communication channel or memory. It is necessary to consider the both characters of media properties in the praxis. The course is streamed to practical and effective processing of multimedia data in databases. Due to it interests in modern technologies based on the optical principles. These technologies are typical by the burst-errors. It is the reason for application the codes with non-binary alphabet as well as convolution codes. These methods are necessary for use in another applications, namely in error-control methods of video signal. The special chapter on the end of course on error-control coding is introduced so called turbo-codes, which are used in radio transmission of data and are considered as the new trend for producers of mobile devices of UMTS generation. Necessary part of data processing is its protection against enemy. The basic methods of ciphering of data are introduced in overview.