Academic Catalog

IE561 STOCHASTIC PROCESSES I

Course Code: 5680561
METU Credit (Theoretical-Laboratory hours/week): 3(3-0)
ECTS Credit: 8.0
Department: Industrial Engineering
Language of Instruction: English
Level of Study: Masters
Course Coordinator: Prof.Dr. ZEYNEP PELÝN BAYINDIR
Offered Semester: Fall or Spring Semesters.

Course Content

Markov chains: Transient and steady state behavior, First Passage times. Markov process: Transient and steady state behavior, First Passage times and phase type distributions. Queuing networks. Markov decision process (MDP): Continuous and discreet time models, MDP as linear programs, MDP under constraints, Maintenance applications. Reliability and maintenance problems: Definition, System configurations, Reliability improvements with cost considerations, Reliability bounds.