Prerequisites: Basic probability, numerical analysis, and programming. Review of basic probability; Monte Carlo simulation; state space models and time series; parameter estimation, prediction and filtering; Markov chains and processes; stochastic control; Markov chain Monte Carlo. Examples from various engineering disciplines.