Academic Catalog

IE561 STOCHASTIC PROCESSES I

Course Code:	5680561
METU Credit (Theoretical-Laboratory hours/week):	3(3-0)
ECTS Credit:	8.0
Department:	Industrial Engineering
Language of Instruction:	English
Level of Study:	Masters
Course Coordinator:	Assoc.Prof.Dr. ZEYNEP PELÝN BAYINDIR
Offered Semester:	Fall or Spring Semesters.

Course Content

Markov chains: Transient and steady state behavior, First Passage times. Markov process: Transient and steady state behavior, First Passage times and phase type distributions. Queuing networks. Markov decision process (MDP): Continuous and discreet time models, MDP as linear programs, MDP under constraints, Maintenance applications. Reliability and maintenance problems: Definition, System configurations, Reliability improvements with cost considerations, Reliability bounds.