Fundamentals of Information Theory
Grunderna inom informationsteori

EIT145F, 7.5 högskolepoäng

Gäller från och med: Spring 2016
Beslutad av: Professor Thomas Johansson
Datum för fastställande: 2016-11-02

Allmänna uppgifter

Avdelning: Electrical and Information Technology
Kurstyp: Ren forskarutbildningskurs
Undervisningsspråk: English

Syfte

Information theory studies the fundamental limits of information transmission and storage. The course is divided into two parts. The aim of Part I is to introduce the fundamental concepts of information theory, focusing on classical point-to-point transmission scenarios. This part is based on selected chapters of the book by Cover/Thomas, which has been widely used as graduate level entry into information theory. In Part II the perspective is extended to multi-user communication scenarios, following selected parts of the book by El Gamal/Kim, which provides an excellent overview of current state-of-art in the field. Using these two books makes the course both up-to-date and self-contained so that no prior background in information theory is required.

Mål

Kunskap och förståelse

För godkänd kurs skall doktoranden

• be well familiar with standard information theoretic concepts
• able to explain the proofs of the source coding theorem and the channel coding theorem
• understand how to generalize the concepts and proofs to multi-user scenarios

Färdighet och förmåga

För godkänd kurs skall doktoranden

• be able to apply information theoretic methods in order to derive fundamental limits for different communication scenarios
• have acquired sufficient knowledge within the field to be able discuss information theory problems with established researchers

Värderingsförmåga och förhållningssätt

För godkänd kurs skall doktoranden

• have demonstrated the ability to independently extract the important content of an extensive document, such as a textbook
• have demonstrated the ability to reflect the material of the course and to understand possibilities and limitations of information theoretic bounds

Kursinnehåll

Part I: entropy, mutual information and their properties, typical sequences, data compression, source coding theorem, channel capacity, channel coding theorem, continuous random variables, differential entropy, Gaussian channels Part II: multiple access channels, broadcast channels, interference channels, channels with state: writing on dirty paper, distributed compression: Slepian-Wolf theorem, Gaussian vector channels, wireless fading channels, relay channels

Kurslitteratur

• Thomas M. Cover, Joy A. Thomas: Elements of Information Theory. Wiley, 2006.
• Gamal, A. & Kim, Y.: Network Information Theory. Cambridge University Press, 2011. ISBN 9781107008731.

Kursens undervisningsformer

Undervisningsformer: Föreläsningar, övningar. The aim of the exercise classes is to discuss the home assignments. The doctoral students should present and discuss ways to solve the problems.

Kursens examination

Examinationsformer: Muntlig tentamen, inlämningsuppgifter. Attendance of at least 80% of the lectures and exercise lessons are a requirement to pass the course.
Betygsskala: Underkänd, godkänd
Examinator: Senior lecturer Michael Lentmaier

Antagningsuppgifter

Förutsatta förkunskaper: Solid skills in engineering mathematics, including probability theory, linear algebra and calculus.
Minsta antal deltagare: 4

Övrig information

Course Coordinator: Michael Lentmaier

Kurstillfällesinformation

Startdatum: 2020-03-23. Startdatumet är ungefärligt.
Slutdatum: 2020-06-30
Kursfart: Full time

Kontaktinformation och övrigt

Kursansvarig: Michael Lentmaier <michael.lentmaier@eit.lth.se>