ВхідSelect major*
Ternopil Ivan Puluj National Technical University
Факультет комп'ютерно-інформаційних систем і програмної інженерії
Кафедра комп'ютерних наук
Fundamentals of Information Theory
syllabus
| Major | 122 - Комп’ютерні науки та інформаційні технології (бакалавр) |
| Field of knowledge | 12 Інформаційні технології |
| Academic degree | bachelor's |
Course
| Course type | elective special education |
||||
| Study start course | 2 | ||||
| Semesters | 4 | ||||
| Form of education | full-time | ||||
| Study hours structure |
|
||||
| Amount of hours for individual work | 96 | ||||
| ECTS credits | 5.0 | ||||
| Form of final examination | exam |
Lecturer
| Academic degree | PhD |
| Full name | Dmytrotsa Lesia |
Prerequirements (prerequisite courses)
| higher mathematics, probability theory, probability processes and mathematical statistics, programming |
Course goals and learning objectives
| The course contains the lectures- theoretical information about the basic concepts in information theory and coding in information systems, the evaluation of quantitative characteristics of the processes of transmission, storage and processing of information, algorithms and software implementations for analyzing information sources, effective coding, basic methods of cryptographic information protection . |
Course description
| Lectures | Module 1. 1. Introduction. Foundations: probability, uncertainty, information. 2. Measure of Information 3. Conditional entropy 4. Information Channels. Module 2. 5. Source Coding. 6. Error correction and detection codes 7. Data compression codes and protocols. 8. Cryptography. 9. Hash function. Digital signature |
| Laboratory classes | Module 1. 1. A quantitative measure of information. Entropy and its properties 2. Entropy of Composite Messages of Dependent Sources. Conditional and Mutual Entropy 3. Characteristics of the source of messages and characteristics of communication channel Module 2. 4. Information encoding. Shannon-Fano coding 5. Huffman Coding 6. Hamming Code. 7. Data compression codes 8. Encryption. Caesar's method. |
Recommended reading list. Subject Resources
| 1. R.M. Gray. Entropy and Information Theory /Springer Science+Business Media, LLC 2011, 409 pages 2. Foundations of Coding: Theory and Applications of Error-Correcting Codes with an Introduction to Cryptography and Information Theory, J. Adamek, Wiley-Interscience 1991 3. Monica Borda. Fundamentals in Information Theory and Coding /Springer-Verlag Berlin, Heidelberg , 2011, 483 pages 4. Cover, T., Thomas, J.: Elements of information theory. Wiley. 5. Richardson, T., Urbanke, R.: Modern Coding Theory. Cambridge University Press. |
Course author
| PhD Dmytrotsa Lesia |
Дата останнього оновлення: 2020-12-08 16:32:13
