Advanced Computational Statistics2025VT
|
|
Course plan
No of lectures
7 lectures (3-4 hours, each)
Recommended for
The course is intended for Ph.D. students from Statistics or a related field (e.g. Mathematical Statistics, Engineering Science, Quantitative Finance, Computer Science).
The course was last given
The course was given in Spring 2023.
Goals
On completion of the course, the student is expected to be able to:
• Demonstrate knowledge of principles of computational statistics
• Explain theoretical and empirical methods to compare different algorithms
• Design and organize algorithms for optimisation, integration, and simulation
of distributions
• Solve statistical computing problems using advanced algorithms
• Adapt a given optimisation, integration, or simulation method to a specific
problem
• Assess, compare and contrast properties of alternative optimisation,
integration, and simulation methods
• Critically judge different methods for optimisation, integration, and
simulation
• Ability to choose an adequate method for a given statistical problem
Prerequisites
Accepted to a doctoral program in Sweden in Statistics or a related field (e.g. Mathematical Statistics, Engineering Science, Quantitative Finance, Computer Science). Knowledge about Statistical Inference (e.g. from the Master's level) and familiarity with a programming language (e.g. with R) is required.
Examination and grading
The intended learning outcomes will be graded by several individual home assignments. The grades given: Pass or Fail.
Content
The course contains fundamental principles of computational statistics. Focus
is on:
• Principles of gradient based and gradient free optimisation including
stochastic optimisation and constrained optimisation
• Introduction to convergence analysis for stochastic optimisation algorithms
• Statistical problem-solving using optimisation, including maximum likelihood,
regularized least squares, and optimal experimental designs
• Principles of numerical integration
• Principles of statistical simulation
• The bootstrap method
• Statistical problem-solving using simulation techniques including generation
of Monte Carlo estimates, their confidence intervals, and posterior
distributions
Literature
• Givens GH, Hoeting JA (2013). Computational Statistics, 2nd edition. John
Wiley & Sons, Inc., Hoboken, New Jersey.
• Goodfellow I, Bengio Y, Courville A (2016). Deep Learning. MIT Press,
http://www.deeplearningbook.org. Focus on Chapter 4, 5, and 8.
• Wright SJ, Recht B (2022). Optimization for data analysis. Cambridge.
• Further literature including research articles and other learning material
will be provided in the course.
Lectures
Lectures and problem sessions will be partly in class (two sessions afternoon to next morning in Linköping) and partly online.
Examination
The Intended Learning Oucomes will be graded by a written exam and/or hand-in solutions to assignments. The grades given: Pass/Fail.
Examiner
Frank Miller
Credits
7.5
Registration
To register for the course, please apply here at the IDA PhD course site or send an email to Frank Miller (frank.miller at liu.se) with your name, department, and name of your supervisor. You are also welcome for any questions related to the course.
Teachers
Lecture 2: Sebastian Mair
Lecture 1, 3-7: Frank Miller
Page responsible: Anne Moe