Information Theory and Error Control Coding - 2021.2

Objectives:

The objective of the course is to introduce the fundamentals of information theory and error control coding. The focus is on the concepts and algorithms required in several areas of communications engineering.

Syllabus and slides:

Part I: Information Theory

1. Introduction - slides

2. Source Coding - slides

3. Channel Capacity - slides

4. Channel Coding Theorem - slides

5. Rate-Distortion Theory - slides

Part II: Error Control Coding

1. Introduction - slides

2. Linear Block Codes - slides

3. LDPC Codes - slides

4. Convolutional Codes - slides

5. Turbo Codes - slides

7. Polar Codes - slides

Assessment:

The assessment is based on lists of tutorial questions (T), an exam paper (E) and a project (P) . The final grade is given by FG = (P +E+ T)/3.

Tutorial questions:

Information theory

List 1

List 2

List 3

List 4

Error control coding

List 1

List 2

List 3

List 4

Matlab codes:

Turbo codes

LDPC codes

Polar codes

Grades:

References:

1. Cover, T., Thomas, J., Elements of Information Theory, 2nd Ed., Wiley, 2006.

2. Moreira, J. C., Farrell, P. G., Essentials of Error-Control Coding, Wiley, 2006.