信息论与编码
学分：3学分
先修课程：实分析与微积分；向量、几何与线性代数；多元微积分与向量分析
课程简介：
信息论与编码产生于有效而可靠的通信问题中，是研究信息的产生、获取、度量、变换、传输、处理、识别及其应用的重要基础学科。通过本课程的学习，使信计专业的学生对信息理论有一个比较全面和系统的了解，掌握信息论的基本概念和信息论方法，为将来从事信息科学的研究和应用提供理论基础。
通过教学要求学生：1.了解信息论的产生、发展、应用及最新研究成果；2.掌握信息度量的基本概念；3.理解和掌握基本的信源编码理论；4.理解信道、信道容量等基本概念；5.掌握基本的信道编码理论、最大熵原理；6.掌握几种无失真信源编码方法，了解通信网中有失真的信源编码与信道容量等信息理论与问题；7.了解有关信息论的应用，其中包括编码与密码学的要点。
教学的主要内容是：阐述香农信息论的基本理论，信源压缩编码及信道编码的具体方法，力图将信息理论与实际实用紧密结合。信息论的基本概念和基本方法包括通信系统模型、信息的度量、最大熵原理、几种无失真信源编码方法、离散信道容量、离散信道编码——线性纠错码、连续信源率失真函数的计算、高斯信道模型等。
成绩评定方式：
评定：学期总评成绩（100％）
重评：补考卷面成绩（100％）
成绩评定要求出勤率
参考教材：
曹雪虹，张宗橙 编著，信息论与编码（第2版），清华大学出版社，2011.06。
Information Theory and Coding
Credits: 3 Credits
Pre-requisite: Real Analysis & the Calculus; Vectors, Geometry & Linear Algebra; Multivariable & Vector Analysis
Description：
Information theory and coding comes from effective and reliable communication problems. It is an important basic discipline that study on selection, access, measurement, transformation, transmission, processing, recognition and application of information. Through teaching, we let students majored in information science and computation have comprehensive and systematic understanding for information theory. Let them to master its basic concepts and methods. The course can provide theoretical basis for engaging in information science research and application for the future.
Through teaching, we request our students to master below knowledge: 1. To know production, development, application and the latest research results of the information theory; 2.To master the basic concept of information metric; 3. To understand and master the basic source encode theory; 4. To understand the basic concept of the channel and the channel capacity, and so on; 5.To master the basic channel coding theory, the maximum entropy principle; 6.To master several non-distorted source encode method and know the question about distorted source encode of communication network and channel capacity; 7.To know the related information theory application, including main points of code theory and cryptology.
The major teaching content is expounding the fundamental theory about Shannon information theory, specific methods of source encoding, channel encoding, and trying to make information theory and actual practical closely integrated, and the basic concept and methods of information theory, including communications system model, the measurement of information, maximum entropy principle, several non-distorted source encoding methods, discrete channel capacity, discrete channel encoding -- linear error correcting codes, consecutive source rate-distortion function, Gaussian channel model, and so on.
Methods of Summative Assessment：
Assessment: Assessments done during semester (100%)
Reassessment: best of 3 hour resit examination (100%)
Attendance at tutorials is a required element of this module.
Textbooks and References：
Cao Xuehong and Zhang Zongcheng, Information Theory and Coding, 2nd Edition, Tsinghua University Press, 2011.06.
Detailed lecture notes will be provided to students.
