# Non-linear regression models for Approximate Bayesian Computation

@article{Blum2010NonlinearRM, title={Non-linear regression models for Approximate Bayesian Computation}, author={Michael G. B. Blum and Olivier François}, journal={Statistics and Computing}, year={2010}, volume={20}, pages={63-73} }

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the curse of dimensionality when the number of summary statistics is increased. Here we propose a machine-learning approach to the estimation of the posterior density by introducing two innovations. The new method fits a nonlinear conditional heteroscedastic… Expand

#### Supplemental Presentations

#### 423 Citations

Choosing summary statistics by least angle regression for approximate Bayesian computation

- Mathematics
- 2016

ABSTRACT Bayesian statistical inference relies on the posterior distribution. Depending on the model, the posterior can be more or less difficult to derive. In recent years, there has been a lot of… Expand

Approximate Bayesian computation

- Mathematics
- 2017

Bayesian statistics provides a principled framework for performing statistical inference for an unknown parameter of a stochastic model assumed to be responsible for generating some observed data.… Expand

On the Asymptotic Efficiency of Approximate Bayesian Computation Estimators

- Mathematics
- 2015

Many statistical applications involve models for which it is difficult to evaluate the likelihood, but from which it is relatively easy to sample. Approximate Bayesian computation is a… Expand

Piecewise Approximate Bayesian Computation: fast inference for discretely observed Markov models using a factorised posterior distribution

- Medicine, Computer Science
- Stat. Comput.
- 2015

This work proposes a new “piecewise” ABC approach suitable for discretely observed Markov models that involves writing the posterior density of the parameters as a product of factors, each a function of only a subset of the data, and then using ABC within each factor. Expand

Approximate Bayesian Computation by Modelling Summary Statistics in a Quasi-likelihood Framework

- Mathematics
- 2015

Approximate Bayesian Computation (ABC) is a useful class of methods for Bayesian inference when the likelihood function is computationally intractable. In practice, the basic ABC algorithm may be… Expand

DR-ABC: Approximate Bayesian Computation with Kernel-Based Distribution Regression

- Mathematics, Computer Science
- ICML
- 2016

A novel framework is developed that model the functional relationship between data distributions and the optimal choice of summary statistics using kernel-based distribution regression and can be implemented in a computationally and statistically efficient way using the random Fourier features framework for large-scale kernel learning. Expand

Approximate Bayesian Computation: A Nonparametric Perspective

- Mathematics
- 2009

Approximate Bayesian Computation is a family of likelihood-free inference techniques that are well suited to models defined in terms of a stochastic generating mechanism. In a nutshell, Approximate… Expand

Fast Approximate Bayesian Computation for discretely observed Markov models using a factorised posterior distribution

- Mathematics
- 2013

Many modern statistical applications involve inference for complicated stochastic models for which the likelihood function is difficult or even impossible to calculate, and hence conventional… Expand

Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation (with Discussion)

- Computer Science, Mathematics
- 2012

This work shows how to construct appropriate summary statistics for ABC in a semi-automatic manner, and shows that optimal summary statistics are the posterior means of the parameters. Expand

#### References

SHOWING 1-10 OF 72 REFERENCES

Approximate Bayesian computation in population genetics.

- Biology, Medicine
- Genetics
- 2002

A key advantage of the method is that the nuisance parameters are automatically integrated out in the simulation step, so that the large numbers of nuisance parameters that arise in population genetics problems can be handled without difficulty. Expand

Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems

- Computer Science, Medicine
- Journal of The Royal Society Interface
- 2008

This paper discusses and applies an ABC method based on sequential Monte Carlo (SMC) to estimate parameters of dynamical models and develops ABC SMC as a tool for model selection; given a range of different mathematical descriptions, it is able to choose the best model using the standard Bayesian model selection apparatus. Expand

Bayesian Data Analysis

- Computer Science, Mathematics
- 1995

Detailed notes on Bayesian Computation Basics of Markov Chain Simulation, Regression Models, and Asymptotic Theorems are provided. Expand

Monte Carlo Methods of Inference for Implicit Statistical Models

- Mathematics
- 1984

A prescribed statistical model is a parametric specification of the distribution of a random vector, whilst an implicit statistical model is one defined at a more fundamental level in terms of a… Expand

Efficient Estimation of Conditional Variance Functions in Stochastic Regression

- Mathematics
- 1998

Conditional heteroscedasticity has been often used in modelling and understanding the variability of statistical data. Under a general setup which includes the nonlinear time series model as a… Expand

Approximate Bayesian Computation for epidemiological models: Application to the Cuban HIV-AIDS epidemic with contact-tracing and unobserved infectious population

- Geography
- 2008

Statistical inference with missing data is a recurrent issue in epidemiology where the infection process is only partially observable. In this paper, Approximate Bayesian Computation, an alternative… Expand

ABC likelihood-free methods for model choice in Gibbs random fields

- Mathematics
- 2008

Gibbs random fields are polymorphous statistical models that can be used to analyse different types of dependence, in particular for spatially correlated data. However, when those models are faced… Expand

Estimating functions in indirect inference

- Mathematics
- 2004

There are models for which the evaluation of the likelihood is infeasible in practice. For these models the Metropolis-Hastings acceptance probability cannot be easily computed. This is the case, for… Expand

Integration within the Felsenstein equation for improved Markov chain Monte Carlo methods in population genetics

- Computer Science, Medicine
- Proceedings of the National Academy of Sciences
- 2007

An approach in which Markov chain Monte Carlo simulations are used to integrate over the space of genealogies, whereas other parameters are integrated out analytically, resulting in an approximation to the full joint posterior density of the model parameters. Expand

Markov chain Monte Carlo without likelihoods

- Computer Science, Medicine
- Proceedings of the National Academy of Sciences of the United States of America
- 2003

A Markov chain Monte Carlo method for generating observations from a posterior distribution without the use of likelihoods is presented, which can be used in frequentist applications, in particular for maximum-likelihood estimation. Expand