Matches in SemOpenAlex for { <https://semopenalex.org/work/W2973674981> ?p ?o ?g. }
- W2973674981 abstract "The importance weighted autoencoder (IWAE) (Burda et al., 2016) is a popular variational-inference method which achieves a tighter evidence bound (and hence a lower bias) than standard variational autoencoders by optimising a multi-sample objective, i.e. an objective that is expressible as an integral over $K > 1$ Monte Carlo samples. Unfortunately, IWAE crucially relies on the availability of reparametrisations and even if these exist, the multi-sample objective leads to inference-network gradients which break down as $K$ is increased (Rainforth et al., 2018). This breakdown can only be circumvented by removing high-variance score-function terms, either by heuristically ignoring them (which yields the 'sticking-the-landing' IWAE (IWAE-STL) gradient from Roeder et al. (2017)) or through an identity from Tucker et al. (2019) (which yields the 'doubly-reparametrised' IWAE (IWAE-DREG) gradient). In this work, we argue that directly optimising the proposal distribution in importance sampling as in the reweighted wake-sleep (RWS) algorithm from Bornschein & Bengio (2015) is preferable to optimising IWAE-type multi-sample objectives. To formalise this argument, we introduce an adaptive-importance sampling framework termed adaptive importance sampling for learning (AISLE) which slightly generalises the RWS algorithm. We then show that AISLE admits IWAE-STL and IWAE-DREG (i.e. the IWAE-gradients which avoid breakdown) as special cases." @default.
- W2973674981 created "2019-09-26" @default.
- W2973674981 creator A5005424936 @default.
- W2973674981 creator A5075419354 @default.
- W2973674981 date "2019-09-25" @default.
- W2973674981 modified "2023-09-27" @default.
- W2973674981 title "On importance-weighted autoencoders" @default.
- W2973674981 cites W1501586228 @default.
- W2973674981 cites W1959608418 @default.
- W2973674981 cites W2022637125 @default.
- W2973674981 cites W2033057584 @default.
- W2973674981 cites W2057487175 @default.
- W2973674981 cites W2057565703 @default.
- W2973674981 cites W2069739265 @default.
- W2973674981 cites W2086206379 @default.
- W2973674981 cites W2119196781 @default.
- W2973674981 cites W2120606562 @default.
- W2973674981 cites W2145781311 @default.
- W2973674981 cites W2287759496 @default.
- W2973674981 cites W2743472713 @default.
- W2973674981 cites W2889028244 @default.
- W2973674981 cites W2923849517 @default.
- W2973674981 cites W2962882862 @default.
- W2973674981 cites W2962947707 @default.
- W2973674981 cites W2963275229 @default.
- W2973674981 cites W2963319343 @default.
- W2973674981 cites W2963383053 @default.
- W2973674981 cites W2963446624 @default.
- W2973674981 cites W2963652898 @default.
- W2973674981 cites W2963682248 @default.
- W2973674981 cites W2963723789 @default.
- W2973674981 cites W2963828071 @default.
- W2973674981 cites W2964121744 @default.
- W2973674981 cites W2964334616 @default.
- W2973674981 cites W2965852464 @default.
- W2973674981 cites W2970256975 @default.
- W2973674981 cites W776338369 @default.
- W2973674981 hasPublicationYear "2019" @default.
- W2973674981 type Work @default.
- W2973674981 sameAs 2973674981 @default.
- W2973674981 citedByCount "4" @default.
- W2973674981 countsByYear W29736749812020 @default.
- W2973674981 countsByYear W29736749812021 @default.
- W2973674981 crossrefType "posted-content" @default.
- W2973674981 hasAuthorship W2973674981A5005424936 @default.
- W2973674981 hasAuthorship W2973674981A5075419354 @default.
- W2973674981 hasConcept C101738243 @default.
- W2973674981 hasConcept C105795698 @default.
- W2973674981 hasConcept C11413529 @default.
- W2973674981 hasConcept C121332964 @default.
- W2973674981 hasConcept C121955636 @default.
- W2973674981 hasConcept C126255220 @default.
- W2973674981 hasConcept C14036430 @default.
- W2973674981 hasConcept C140779682 @default.
- W2973674981 hasConcept C144133560 @default.
- W2973674981 hasConcept C154945302 @default.
- W2973674981 hasConcept C167723999 @default.
- W2973674981 hasConcept C19499675 @default.
- W2973674981 hasConcept C196083921 @default.
- W2973674981 hasConcept C198531522 @default.
- W2973674981 hasConcept C2776214188 @default.
- W2973674981 hasConcept C28826006 @default.
- W2973674981 hasConcept C33923547 @default.
- W2973674981 hasConcept C41008148 @default.
- W2973674981 hasConcept C50644808 @default.
- W2973674981 hasConcept C52740198 @default.
- W2973674981 hasConcept C76155785 @default.
- W2973674981 hasConcept C78458016 @default.
- W2973674981 hasConcept C86803240 @default.
- W2973674981 hasConcept C94915269 @default.
- W2973674981 hasConcept C97355855 @default.
- W2973674981 hasConceptScore W2973674981C101738243 @default.
- W2973674981 hasConceptScore W2973674981C105795698 @default.
- W2973674981 hasConceptScore W2973674981C11413529 @default.
- W2973674981 hasConceptScore W2973674981C121332964 @default.
- W2973674981 hasConceptScore W2973674981C121955636 @default.
- W2973674981 hasConceptScore W2973674981C126255220 @default.
- W2973674981 hasConceptScore W2973674981C14036430 @default.
- W2973674981 hasConceptScore W2973674981C140779682 @default.
- W2973674981 hasConceptScore W2973674981C144133560 @default.
- W2973674981 hasConceptScore W2973674981C154945302 @default.
- W2973674981 hasConceptScore W2973674981C167723999 @default.
- W2973674981 hasConceptScore W2973674981C19499675 @default.
- W2973674981 hasConceptScore W2973674981C196083921 @default.
- W2973674981 hasConceptScore W2973674981C198531522 @default.
- W2973674981 hasConceptScore W2973674981C2776214188 @default.
- W2973674981 hasConceptScore W2973674981C28826006 @default.
- W2973674981 hasConceptScore W2973674981C33923547 @default.
- W2973674981 hasConceptScore W2973674981C41008148 @default.
- W2973674981 hasConceptScore W2973674981C50644808 @default.
- W2973674981 hasConceptScore W2973674981C52740198 @default.
- W2973674981 hasConceptScore W2973674981C76155785 @default.
- W2973674981 hasConceptScore W2973674981C78458016 @default.
- W2973674981 hasConceptScore W2973674981C86803240 @default.
- W2973674981 hasConceptScore W2973674981C94915269 @default.
- W2973674981 hasConceptScore W2973674981C97355855 @default.
- W2973674981 hasLocation W29736749811 @default.
- W2973674981 hasOpenAccess W2973674981 @default.
- W2973674981 hasPrimaryLocation W29736749811 @default.
- W2973674981 hasRelatedWork W1857572788 @default.