WiSe 15/16: Uncertainty Quantification
Tim Sullivan
Kommentar
Module Aims. Uncertainty Quantification (UQ) is a research area of growing theoretical and practical importance at the intersection of applied mathematics, probability, statistics, computational science and engineering (CSE) and many application areas. UQ can be seen as the theory and numerical application of probability/statistics to problems and models with a strong “real-world” (especially physics- or engineering-based) setting.
This course will provide an introduction to the basic problems and methods of UQ from a mostly mathematical point of view, with numerical exercises so that the methods can be seen to work in (small) practical settings. More generally, the aim is to provide an introduction to some relatively diverse methods of applied mathematics and applied probability as they are used in practice, through the particular unifying theme of UQ.
Objectives. By the end of the module students should be able to understand both the basic theory of, and in example settings perform:
- sensitivity and variance analysis
- orthogonal systems of polynomials and their applications
- spectral decomposition methods
- finite- and infinite-dimensional optimization methods
- data assimilation and filtering
- Bayesian perspectives on inverse problems.
Topics / Table of Contents. This is a list of possible topics, not all of which will necessarily be covered in the module.
- Introduction and Course Outline
a. Typical UQ problems and motivating examples: certification, prediction, inversion.
b. Epistemic and aleatoric uncertainty. Bayesian and frequentist interpretations of probability. - Preliminaries
a. Hilbert space theory: direct sums; orthogonal decompositions and approximations; tensor products; Riesz representation and Lax–Milgram theorems. [Mostly recap.]
b. Probability theory: axioms, integration, sampling, key inequalities and limit theorems. [Mostly recap.]
c. Optimization: least squares; linear/quadratic/convex programming; extreme points. - Inverse Problems and Bayesian Perspectives
a. Ill-posedness of inverse problems, regularization.
b. Bayesian inversion in Banach spaces.
c. State estimation and data assimilation, e.g. Kálmán filter. - Orthogonal Polynomials
a. Basic definitions and properties.
b. Polynomial interpolation and approximation. - Numerical Evaluation of Integrals
a. Deterministic methods: uniform sampling, Newton–Cotes formulae, Gaussian quadrature, Clenshaw-Curtis quadrature, sparse quadrature.
b. Random methods: Monte Carlo and variants.
c. Pseudo-random methods: low-discrepancy sequences, Koksma–Hlawka inequality. - Sensitivity Analysis
a. Estimation of derivatives.
b. "L8" sensitivity indices, e.g. McDiarmid subdiameters; associated concentration-of-measure inequalities.
c. ANOVA and "L2" sensitivity indices, e.g. Sobol' indices.
d. Model reduction. - Spectral Methods
a. Polynomial chaos: Wiener–Hermite expansions, generalized PC expansions, changes of PC basis.
b. Intrusive (Galerkin) methods: deterministic and stochastic Galerkin projection.
c. Non-intrusive spectral projection, stochastic collocation methods. - Optimization Methods
a. Mixed epistemic/aleatoric uncertainty; the robust Bayesian paradigm.
b. Finite-dimensional parametric studies; convex programs.
c. Optimal UQ / distributionally-robust optimization: formulation, reduction, computation.
Literaturhinweise
The following books will be relevant:
- O. P. Le Maître and O. M. Knio. Spectral Methods for Uncertainty Quantification: With Applications to Computational Fluid Dynamics. Scientific Computation. Springer, New York, 2010.
- R. C. Smith. Uncertainty Quantification: Theory, Implementation, and Applications, volume 12 of Computational Science & Engineering. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2014.
- T. J. Sullivan. Introduction to Uncertainty Quantification. Springer, New York, in press.
- D. Xiu. Numerical Methods for Stochastic Computations: A Spectral Method Approach. Princeton University Press, Princeton, NJ, 2010.
16 Termine
Regelmäßige Termine der Lehrveranstaltung