Probability, Random Processes, and Statistics; Markov Chains; Sampling and Monte Carlo Methods; Parameter Estimation; Uncertainty Propagation in Models; Stochastic Spectral Methods; Surrogate Models and Advanced Topics.

For further information see the academic catalog: IAM768

Course Objectives: Students are expected to gain, besides theoretical concepts, programming skills that are related to Uncertainty Quantification and related applications.

Course Learning Outcomes: By the end of this course, students should be equipped with fundamental methods of Uncertainty Quantification, and related concepts from Scientific Computing, Finance and Statistics, and Physics and Engineering.

Instructional Methods: Classical Lectures and Presentation of Students.

Course Website / Course Management System: odtuclass.iam.metu.edu.tr

Weekly Outline / Tentative Course Schedule: 

  • Introduction and Preliminaries
    • Motivating Applications and Prototypical Models
    • Probability, Random Processes, and Statistics; Markov Chains
  • Sampling and Monte Carlo Methods
    • Computing Expectations/Integrals, Moments; Moment Approximations using Limit Theorems
    • Monte Carlo Methods, variance reduction techniques; importance sampling
  • Parameter Estimation
    • Frequentist Techniques: Linear Regression, Nonlinear Parameter Estimation, Optimisation and Algorithms (related content from least squares, regularization, etc.)
    • Bayesian Techniques: Markov Chain Monte Carlo, Metropolis-Hasting Algorithms, and Sequential Monte Carlo and Particle Filter; Delayed Rejection Adaptive Metropolis (DRAM), DiffeRential Evolution Adaptive Metropolis (DREAM)
  • Stochastic Spectral Methods
    • Orthogonal Polynomials, Piecewise Polynomial Approximation, Interpolation, Projection, (Gaussian) Quadrature Rules; Finite Elements (and, possibly, Finite Differences), Galerkin (Finite Element) Methods, (Polynomial) Spectral Methods
    • Spectral Expansion and Stochastic Spectral Methods: Karhunen-Loève Expansion, (generalised) Polynomial Chaos Expansion (gPC); Stochastic Galerkin Methods, Collocation, and Discrete Projection
  • Surrogate Models and Advanced Topics

Required Textbook/s & Readings:

  • Ralph C. Smith, Uncertainty Quantification: Theory, Implementation, and Applications, SIAM, 2014
  • O. P. Le Maître, O. M. Knio, Spectral Methods for Uncertainty Quantification: with applications to Computational Fluid Dynamics, Springer, 2010
  • Mats G. Larson, Fredrik Bengzon, The Finite Element Method: Theory, Implementation, and Applications, Springer, 2013
  • Steven M. Kay, Intuitive Probability and Random Processes using MATLAB, Springer, 2006
  • Paul Glasserman, Monte Carlo Methods in Financial Engineering, Springer, 2003