Third-Cycle Courses

Faculty of Engineering | Lund University

Details for Course FMSF15F Markov Processes

Printable view

  • FMSF15F
  • Temporary
Course Name
  • Markov Processes
Course Extent
  • 7.5
Type of Instruction
  • Course given jointly for second and third cycle
Administrative Information
  • 7152 (Centre of Mathematical Sciences / Mathematical Statistics)
  • 2020-05-18
  • Anders Gustafsson / FUN

Current Established Course Syllabus

  • Markov chains and processes are a class of models which, apart from a rich mathematical structure, also has applications in many disciplines, such as telecommunications and production (queue and inventory theory), reliability analysis, financial mathematics (e.g., hidden Markov models), automatic control, and image processing (Markov fields).

    The aim of this course is to give the student the basic concepts and methods for Poisson processes, discrete Markov chains and processes, and also the ability to apply them. The course presents examples of applications in different fields, in order to facilitate the use of the knowledge in other courses where Markov models appear.
  • Markov chains: model graphs, Markov property, transition probabilities, persistent and transient states, positive and null persistent states, communication, existence and uniqueness of stationary distribution, and calculation thereof, absorption times.

    Poisson process: Law of small numbers, counting processes, event distance, non-homogeneous processes, diluting and super positioning, processes on general spaces.

    Markov processes: transition intensities, time dynamic, existence and uniqueness of stationary distribution, and calculation thereof, birth-death processes, absorption times.

    Introduction to renewal theory and regenerative processes.
Knowledge and Understanding
  • For a passing grade the doctoral student must
  • be able to explain the Markov property and the intensity concept, as well as the concepts of recurrence, communication, stationary distribution, and how they relate to each other,
    be able to perform calculations of stationary distributions and absorption times for discrete Markov chains and processes,
    be able to explain the suitability of the Poisson process as a model for rare events and perform calculations of probabilities using the properties of the Poisson process in one and several dimensions.
Competences and Skills
  • For a passing grade the doctoral student must
  • be able to construct a model graph for a Markov chain or process describing a given system, and use the model for studying the system,
    be able to in connection with problem solving, show ability to integrate knowledge from the different parts of the course,
    be able to read and interpret basic literature with elements of Markov models and their applications.
Judgement and Approach
  • For a passing grade the doctoral student must
  • be able to identify problems that can be solved using Markov models, and choose an appropriate method,
    be able to use knowledge of Markov models in other courses, as transfer concepts, tools, and knowledge between different courses where Markov models are used.
Types of Instruction
  • Lectures
  • Laboratory exercises
  • Exercises
Examination Formats
  • Written exam
  • Failed, pass
Admission Requirements
Assumed Prior Knowledge
  • A basic course in mathematical statistics and knowledge in complex and linear analysis.
Selection Criteria
  • Lindgren, G. & Rydén, T.: Markovprocesser. KFS, 2002.
Further Information
Course code
  • FMSF15F
Administrative Information
  • 2020-05-18
  • Anders Gustafsson / FUN

All Established Course Syllabi

1 course syllabus.

Valid from First hand in Second hand in Established
Autumn 2020 2020‑05‑15 11:53:00 2020‑05‑15 11:54:12 2020‑05‑18

Current or Upcoming Published Course Occasion

No matching course occasion was found.

All Published Course Occasions

1 course occasion.

Course syllabus valid from Start Date End Date Published
Autumn 2020 2020‑08‑31 2020‑10‑30

Printable view