Adaptive rejection Metropolis sampling using Lagrange interpolation polynomials of degree 2

Department of Statistics, University of Auckland, Private Bag 92019, Auckland, New Zealand; Department of Epidemiology and Biostatistics, University of South Carolina, Columbia, SC 29208, United States; Department of Mathematics and Statistics, University of Montreal, Montreal, Quebec, Canada H3C 3J7
Computational Statistics & Data Analysis (Impact Factor: 1.3). 01/2008; DOI: 10.1016/j.csda.2008.01.005
Source: DBLP

ABSTRACT A crucial problem in Bayesian posterior computation is efficient sampling from a univariate distribution, e.g. a full conditional distribution in applications of the Gibbs sampler. This full conditional distribution is usually non-conjugate, algebraically complex and computationally expensive to evaluate. We propose an alternative algorithm, called ARMS2, to the widely used adaptive rejection sampling technique ARS [Gilks, W.R., Wild, P., 1992. Adaptive rejection sampling for Gibbs sampling. Applied Statistics 41 (2), 337–348; Gilks, W.R., 1992. Derivative-free adaptive rejection sampling for Gibbs sampling. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (Eds.), Bayesian Statistics, Vol. 4. Clarendon, Oxford, pp. 641–649] for generating a sample from univariate log-concave densities. Whereas ARS is based on sampling from piecewise exponentials, the new algorithm uses truncated normal distributions and makes use of a clever auxiliary variable technique [Damien, P., Walker, S.G., 2001. Sampling truncated normal, beta, and gamma densities. Journal of Computational and Graphical Statistics 10 (2) 206–215]. Furthermore, we extend this algorithm to deal with non-log-concave densities to provide an enhanced alternative to adaptive rejection Metropolis sampling, ARMS [Gilks, W.R., Best, N.G., Tan, K.K.C., 1995. Adaptive rejection Metropolis sampling within Gibbs sampling. Applied Statistics 44, 455–472]. The performance of ARMS and ARMS2 is compared in simulations of standard univariate distributions as well as in Gibbs sampling of a Bayesian hierarchical state-space model used for fisheries stock assessment.

  • [Show abstract] [Hide abstract]
    ABSTRACT: To obtain the probability density functions and the cumulative distribution functions of static responses of stochastic structures, a hybrid stochastic method named as the transformed perturbation stochastic finite element method (TPSFEM) is proposed. In TPSFEM, the static responses of stochastic structures are approximated as the linear functions of random variables by using the first order perturbation technique. According to the approximated linear relationships between static responses and random variables, the probability density functions of static responses are obtained by the change-of-variable technique. The cumulative distribution functions of static responses are calculated by the numerical integration method. The numerical examples on a thin plate, a six-bar truss structure, a Mindlin plate and a shell structure verify the effectiveness and accuracy of the proposed method. Hence, the proposed method can be considered as an alternative engineering method for the static response analysis of stochastic structures.
    Finite Elements in Analysis and Design 01/2014; 79:9–21. · 1.39 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: We introduce a new class of adaptive Metropolis algorithms called adaptive sticky algorithms for efficient general-purpose simulation from a target probability distribution. The transition of the Metropolis chain is based on a multiple-try scheme and the different proposals are generated by adaptive nonparametric distributions. Our adaptation strategy uses the interpolation of support points from the past history of the chain as in the adaptive rejection Metropolis. The algorithm efficiency is strengthened by a step that controls the evolution of the set of support points. This extra stage improves the computational cost and accelerates the convergence of the proposal distribution to the target. Despite the algorithms are presented for univariate target distributions, we show that they can be easily extended to the multivariate context by a Gibbs sampling strategy. We show the ergodicity of the proposed algorithms and illustrate their efficiency and effectiveness through some simulated examples involving target distributions with complex structures.
    SSRN Electronic Journal 08/2013;
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Adaptive Rejection Metropolis Sampling (ARMS) is a well-known MCMC scheme for generating samples from one-dimensional target distributions. ARMS is widely used within Gibbs sampling, where automatic and fast samplers are of-ten needed to draw from univariate full-conditional densities. In this work, we propose an alternative adaptive algorithm (IA 2 RMS) that overcomes the main drawback of ARMS (an uncomplete adaptation of the proposal in some cases), speed-ing up the convergence of the chain to the target. Numerical results show that IA 2 RMS outperforms the standard ARMS, providing a correlation among samples close to zero. Index Terms— Monte Carlo methods, Gibbs sampler, adaptive rejection Metropolis sampling (ARMS).
    IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); 01/2014


Available from