Vol. 15, No. 1, 2020
Download this article
Download this article For screen
For printing
Recent Issues
Volume 18, Issue 1
Volume 17, Issue 1
Volume 16, Issue 2
Volume 16, Issue 1
Volume 15, Issue 2
Volume 15, Issue 1
Volume 14, Issue 2
Volume 14, Issue 1
Volume 13, Issue 2
Volume 13, Issue 1
Volume 12, Issue 1
Volume 11, Issue 2
Volume 11, Issue 1
Volume 10, Issue 2
Volume 10, Issue 1
Volume 9, Issue 2
Volume 9, Issue 1
Volume 8, Issue 1
Volume 7, Issue 2
Volume 7, Issue 1
Volume 6, Issue 1
Volume 5, Issue 2
Volume 5, Issue 1
Volume 4, Issue 1
Volume 3, Issue 1
Volume 2, Issue 1
Volume 1, Issue 1
The Journal
About the Journal
Editorial Board
Subscriptions
 
Submission Guidelines
Submission Form
Policies for Authors
Ethics Statement
 
ISSN: 2157-5452 (e-only)
ISSN: 1559-3940 (print)
Author Index
To Appear
 
Other MSP Journals
This article is available for purchase or by subscription. See below.
A stochastic version of Stein variational gradient descent for efficient sampling

Lei Li, Yingzhou Li, Jian-Guo Liu, Zibu Liu and Jianfeng Lu
Vol. 15 (2020), No. 1, 37–63
DOI: 10.2140/camcos.2020.15.37
Abstract

We propose in this work RBM-SVGD, a stochastic version of the Stein variational gradient descent (SVGD) method for efficiently sampling from a given probability measure, which is thus useful for Bayesian inference. The method is to apply the random batch method (RBM) for interacting particle systems proposed by Jin et al. to the interacting particle systems in SVGD. While keeping the behaviors of SVGD, it reduces the computational cost, especially when the interacting kernel has long range. We prove that the one marginal distribution of the particles generated by this method converges to the one marginal of the interacting particle systems under Wasserstein-2 distance on fixed time interval [0,T]. Numerical examples verify the efficiency of this new version of SVGD.

PDF Access Denied

We have not been able to recognize your IP address 18.226.177.223 as that of a subscriber to this journal.
Online access to the content of recent issues is by subscription, or purchase of single articles.

Please contact your institution's librarian suggesting a subscription, for example by using our journal-recom­mendation form. Or, visit our subscription page for instructions on purchasing a subscription.

You may also contact us at contact@msp.org
or by using our contact form.

Or, you may purchase this single article for USD 40.00:

Keywords
random batch method, RBM-SVGD, nonparametric variational inference, KL divergence, reproducing kernel Hilbert space, MCMC
Mathematical Subject Classification 2010
Primary: 62D05, 65C35
Milestones
Received: 10 April 2019
Revised: 12 November 2019
Accepted: 14 December 2019
Published: 3 June 2020
Authors
Lei Li
School of Mathematical Sciences
Institute of Natural Sciences
Key Lab of Scientific and Engineering Computing, Ministry of Education
Shanghai Jiao Tong University
Shanghai
China
Yingzhou Li
Department of Mathematics
Duke University
Durham, NC
United States
Jian-Guo Liu
Department of Mathematics
Department of Physics
Duke University
Durham, NC
United States
Zibu Liu
Department of Mathematics
Duke University
Durham, NC
United States
Jianfeng Lu
Department of Mathematics
Department of Physics
Department of Chemistry
Duke University
Durham, NC
United States