Parallelized integrated nested Laplace approximations for fast Bayesian inference
Additional information
Authors
Gaedke-Merzhäuser L.,
Van Niekerk J.,
Schenk O.,
Rue H.
Type
Journal Article
Year
2022
Language
English
Abstract
There is a growing demand for performing larger-scale Bayesian inference tasks, arising from greater data availability and higher-dimensional model parameter spaces. In this work we present parallelization strategies for the methodology of integrated nested Laplace approximations (INLA), a popular framework for performing approximate Bayesian inference on the class of Latent Gaussian models. Our approach makes use of nested thread-level parallelism, a parallel line search procedure using robust regression in INLA’s optimization phase and the state-of-the-art sparse linear solver PARDISO. We leverage mutually independent function evaluations in the algorithm as well as advanced sparse linear algebra techniques. This way we can flexibly utilize the power of today’s multi-core architectures. We demonstrate the performance of our new parallelization scheme on a number of different real-world applications. The introduction of parallelism leads to speedups of a factor 10 and more for all larger models. Our work is already integrated in the current version of the open-source R-INLA package, making its improved performance conveniently available to all users.
Journal
Statistics and Computing
Start page number
1
End page number
20
Keywords
Bayesian inference, NLA, Parallelism, Mathematical software
