Generalized Multiple Importance Sampling
Document type :
Article dans une revue scientifique: Article original
DOI :
Title :
Generalized Multiple Importance Sampling
Author(s) :
Elvira, Víctor [Auteur]
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]
Institut TELECOM/TELECOM Lille1
Martino, Luca [Auteur]
Universitat de València = University of Valencia [UV]
Luengo, David [Auteur]
Bugallo, Mónica F. [Auteur]
Stony Brook University [SUNY] [SBU]
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]
Institut TELECOM/TELECOM Lille1
Martino, Luca [Auteur]
Universitat de València = University of Valencia [UV]
Luengo, David [Auteur]
Bugallo, Mónica F. [Auteur]
Stony Brook University [SUNY] [SBU]
Journal title :
Statistical Science
Pages :
129-155
Publisher :
Institute of Mathematical Statistics (IMS)
Publication date :
2019
ISSN :
0883-4237
HAL domain(s) :
Informatique [cs]/Traitement du signal et de l'image [eess.SP]
Sciences de l'ingénieur [physics]/Traitement du signal et de l'image [eess.SP]
Sciences de l'ingénieur [physics]/Traitement du signal et de l'image [eess.SP]
English abstract : [en]
Importance sampling (IS) methods are broadly used to approximate posterior distributions or their moments. In the standard IS approach, samples are drawn from a single proposal distribution and weighted adequately. However, ...
Show more >Importance sampling (IS) methods are broadly used to approximate posterior distributions or their moments. In the standard IS approach, samples are drawn from a single proposal distribution and weighted adequately. However, since the performance in IS depends on the mismatch between the targeted and the proposal distributions, several proposal densities are often employed for the generation of samples. Under this multiple importance sampling (MIS) scenario, extensive literature has addressed the selection and adaptation of the proposal distributions, interpreting the sampling and weighting steps in different ways. In this paper, we establish a novel general framework with sampling and weighting procedures when more than one proposal is available. The new framework encompasses most relevant MIS schemes in the literature, and novel valid schemes appear naturally. All the MIS schemes are compared and ranked in terms of the variance of the associated estimators. Finally, we provide illustrative examples revealing that, even with a good choice of the proposal densities, a careful interpretation of the sampling and weighting procedures can make a significant difference in the performance of the method.Show less >
Show more >Importance sampling (IS) methods are broadly used to approximate posterior distributions or their moments. In the standard IS approach, samples are drawn from a single proposal distribution and weighted adequately. However, since the performance in IS depends on the mismatch between the targeted and the proposal distributions, several proposal densities are often employed for the generation of samples. Under this multiple importance sampling (MIS) scenario, extensive literature has addressed the selection and adaptation of the proposal distributions, interpreting the sampling and weighting steps in different ways. In this paper, we establish a novel general framework with sampling and weighting procedures when more than one proposal is available. The new framework encompasses most relevant MIS schemes in the literature, and novel valid schemes appear naturally. All the MIS schemes are compared and ranked in terms of the variance of the associated estimators. Finally, we provide illustrative examples revealing that, even with a good choice of the proposal densities, a careful interpretation of the sampling and weighting procedures can make a significant difference in the performance of the method.Show less >
Language :
Anglais
Peer reviewed article :
Oui
Audience :
Internationale
Popular science :
Non
ANR Project :
Collections :
Source :
Files
- http://arxiv.org/pdf/1511.03095
- Open access
- Access the document
- 1511.03095
- Open access
- Access the document