Select major*

Ternopil Ivan Puluj National Technical University

Факультет комп'ютерно-інформаційних систем і програмної інженерії

Кафедра комп'ютерних наук

Fundamentals of Information Theory


Major 122 - Комп’ютерні науки та інформаційні технології (бакалавр)
Field of knowledge 12 Інформаційні технології
Academic degree bachelor's
Course type elective
special education
Study start course 2
Semesters 4
Form of education full-time
Study hours structure
18– lectures
36– laboratory classes
Amount of hours for individual work 96
ECTS credits 5.0
Form of final examination exam
Academic degree PhD
Full name Dmytrotsa Lesia
Prerequirements (prerequisite courses)
higher mathematics,
probability theory, probability processes and mathematical statistics,
Course goals and learning objectives
The course contains the lectures- theoretical information about the basic concepts in information theory and coding in information systems, the evaluation of quantitative characteristics of the processes of transmission, storage and processing of information, algorithms and software implementations for analyzing information sources, effective coding, basic methods of cryptographic information protection . 
Course description
Lectures Module 1.
1. Introduction. Foundations: probability, uncertainty, information.
2. Measure of Information
3. Conditional entropy
4. Information Channels.
Module 2.
5. Source Coding.
6. Error correction and detection codes
7. Data compression codes and protocols.
8. Cryptography.
9. Hash function. Digital signature
Laboratory classes Module 1.
1. A quantitative measure of information. Entropy and its properties
2. Entropy of Composite Messages of Dependent Sources. Conditional and Mutual Entropy
3. Characteristics of the source of messages and characteristics of communication channel
Module 2.
4. Information encoding. Shannon-Fano coding
5. Huffman Coding
6. Hamming Code.
7. Data compression codes
8. Encryption. Caesar's method.
Recommended reading list. Subject Resources
1. R.M. Gray. Entropy and Information Theory /Springer Science+Business Media, LLC 2011, 409 pages
2. Foundations of Coding: Theory and Applications of Error-Correcting Codes with an Introduction to Cryptography and Information Theory, J. Adamek, Wiley-Interscience 1991
3. Monica Borda. Fundamentals in Information Theory and Coding /Springer-Verlag Berlin, Heidelberg , 2011, 483 pages
4. Cover, T., Thomas, J.: Elements of information theory. Wiley.
5. Richardson, T., Urbanke, R.: Modern Coding Theory. Cambridge University Press. 
Course author
PhD Dmytrotsa Lesia 
Дата останнього оновлення: 2020-12-08 16:32:13