Fast Updating of Bayesian Models

点击翻译按钮获取中文摘要

Bayesian inference provides a powerful tool for modelling complex data and quantifying uncertainty, and has been used to solve problems in many areas including epidemiology, climatology, signal process-ing, to name a few. In the applications of Bayesian inference, a common requirement is the ability to update Bayesian models quickly. This is especially desired when, for example, building models iteratively to reflect a change in the prior beliefs, to incorporate new observations into the model, or to correct the model after rectication of old data. A concrete example is in epidemiological modelling of the COVID-19 transmission, where a Bayesian model is built to predict the daily coronavirus cases, and new posterior fits are required every day as new data are collected and fed into the model. Another example is model development, where practitioners often wish to make adjustments to elements of themodel to account for changes in their prior believes.In this setting, which we term iterative Bayesian modelling, practitioners often have had a posterior sample for the t of the previous model at their disposal, and wish to obtain a new sample for the updated model. The traditional approach to iterative Bayesian modelling is to run a Bayesian inference method from scratch each time the model is updated. Although this can yield state-of-the-art approximation accuracy, it is undesirable since these Bayesian inference methods are often computationally expensive, and the computation spent in fitting the old models would be wasted. Existing literature has provided theoretical results on when re-using old fits could help the fitting of a new model, but this remains an ununified area of research. In this PhD project, we aim to explore different methods that can make use of the t to the old model to accelerate the fitting of the updatedmodel. Some objectives of this project are:1. Designing algorithms that are able to update Bayesian models quickly under assumptions on the form of the changes to the model.2. Reviewing and extending existing Bayesian inference methods to allow re-use of previous fits, and making comprehensive comparisons on their advantages and limitations.3. Unifying the existing literature on the theoretical results of when re-using previous fits can be more beneficial than running a Bayesian method from scratch, thus providing theoretical justificationsto the use of these algorithms in iterative Bayesian modelling.This project falls within the EPSRC research area of Mathematical Sciences. If successful, it can shed light on the development of programming software that allows rapid model updating or modeldevelopment, thereby beneting the wide community of practitioners of Bayesian statistics.1