Matches in SemOpenAlex for { <https://semopenalex.org/work/W3022749775> ?p ?o ?g. }
- W3022749775 abstract "Variational autoencoders (VAEs) are a standard framework for inducing latent variable models that have been shown effective in learning text representations as well as in text generation. The key challenge with using VAEs is the {it posterior collapse} problem: learning tends to converge to trivial solutions where the generators ignore latent variables. In our Levenstein VAE, we propose to replace the evidence lower bound (ELBO) with a new objective which is simple to optimize and prevents posterior collapse. Intuitively, it corresponds to generating a sequence from the autoencoder and encouraging the model to predict an optimal continuation according to the Levenshtein distance (LD) with the reference sentence at each time step in the generated sequence. We motivate the method from the probabilistic perspective by showing that it is closely related to optimizing a bound on the intractable Kullback-Leibler divergence of an LD-based kernel density estimator from the model distribution. With this objective, any generator disregarding latent variables will incur large penalties and hence posterior collapse does not happen. We relate our approach to policy distillation cite{RossGB11} and dynamic oracles cite{GoldbergN12}. By considering Yelp and SNLI benchmarks, we show that Levenstein VAE produces more informative latent representations than alternative approaches to preventing posterior collapse." @default.
- W3022749775 created "2020-05-13" @default.
- W3022749775 creator A5065341276 @default.
- W3022749775 creator A5086717154 @default.
- W3022749775 date "2020-04-30" @default.
- W3022749775 modified "2023-09-27" @default.
- W3022749775 title "Preventing Posterior Collapse with Levenshtein Variational Autoencoder" @default.
- W3022749775 cites W114517082 @default.
- W3022749775 cites W1632114991 @default.
- W3022749775 cites W1646152356 @default.
- W3022749775 cites W1647671624 @default.
- W3022749775 cites W1815076433 @default.
- W3022749775 cites W1840435438 @default.
- W3022749775 cites W1880262756 @default.
- W3022749775 cites W1999874108 @default.
- W3022749775 cites W2006969979 @default.
- W3022749775 cites W2019044526 @default.
- W3022749775 cites W2064675550 @default.
- W3022749775 cites W2097998348 @default.
- W3022749775 cites W2163993443 @default.
- W3022749775 cites W2530741948 @default.
- W3022749775 cites W2584377191 @default.
- W3022749775 cites W2596367596 @default.
- W3022749775 cites W2622563070 @default.
- W3022749775 cites W2753738274 @default.
- W3022749775 cites W2924334974 @default.
- W3022749775 cites W2962686221 @default.
- W3022749775 cites W2962717182 @default.
- W3022749775 cites W2962738009 @default.
- W3022749775 cites W2962897886 @default.
- W3022749775 cites W2962923909 @default.
- W3022749775 cites W2962957031 @default.
- W3022749775 cites W2962964385 @default.
- W3022749775 cites W2963223306 @default.
- W3022749775 cites W2963248296 @default.
- W3022749775 cites W2963366196 @default.
- W3022749775 cites W2963600562 @default.
- W3022749775 cites W2963742216 @default.
- W3022749775 cites W2963987720 @default.
- W3022749775 cites W2964000524 @default.
- W3022749775 cites W2964222296 @default.
- W3022749775 cites W2970454257 @default.
- W3022749775 cites W2990155616 @default.
- W3022749775 cites W2996287690 @default.
- W3022749775 cites W3034905905 @default.
- W3022749775 cites W595069947 @default.
- W3022749775 cites W648786980 @default.
- W3022749775 hasPublicationYear "2020" @default.
- W3022749775 type Work @default.
- W3022749775 sameAs 3022749775 @default.
- W3022749775 citedByCount "4" @default.
- W3022749775 countsByYear W30227497752020 @default.
- W3022749775 countsByYear W30227497752021 @default.
- W3022749775 crossrefType "posted-content" @default.
- W3022749775 hasAuthorship W3022749775A5065341276 @default.
- W3022749775 hasAuthorship W3022749775A5086717154 @default.
- W3022749775 hasConcept C101738243 @default.
- W3022749775 hasConcept C105795698 @default.
- W3022749775 hasConcept C107673813 @default.
- W3022749775 hasConcept C108583219 @default.
- W3022749775 hasConcept C119857082 @default.
- W3022749775 hasConcept C134306372 @default.
- W3022749775 hasConcept C138885662 @default.
- W3022749775 hasConcept C154945302 @default.
- W3022749775 hasConcept C185429906 @default.
- W3022749775 hasConcept C207390915 @default.
- W3022749775 hasConcept C2778112365 @default.
- W3022749775 hasConcept C33923547 @default.
- W3022749775 hasConcept C41008148 @default.
- W3022749775 hasConcept C41895202 @default.
- W3022749775 hasConcept C51167844 @default.
- W3022749775 hasConcept C54355233 @default.
- W3022749775 hasConcept C57830394 @default.
- W3022749775 hasConcept C77553402 @default.
- W3022749775 hasConcept C86803240 @default.
- W3022749775 hasConceptScore W3022749775C101738243 @default.
- W3022749775 hasConceptScore W3022749775C105795698 @default.
- W3022749775 hasConceptScore W3022749775C107673813 @default.
- W3022749775 hasConceptScore W3022749775C108583219 @default.
- W3022749775 hasConceptScore W3022749775C119857082 @default.
- W3022749775 hasConceptScore W3022749775C134306372 @default.
- W3022749775 hasConceptScore W3022749775C138885662 @default.
- W3022749775 hasConceptScore W3022749775C154945302 @default.
- W3022749775 hasConceptScore W3022749775C185429906 @default.
- W3022749775 hasConceptScore W3022749775C207390915 @default.
- W3022749775 hasConceptScore W3022749775C2778112365 @default.
- W3022749775 hasConceptScore W3022749775C33923547 @default.
- W3022749775 hasConceptScore W3022749775C41008148 @default.
- W3022749775 hasConceptScore W3022749775C41895202 @default.
- W3022749775 hasConceptScore W3022749775C51167844 @default.
- W3022749775 hasConceptScore W3022749775C54355233 @default.
- W3022749775 hasConceptScore W3022749775C57830394 @default.
- W3022749775 hasConceptScore W3022749775C77553402 @default.
- W3022749775 hasConceptScore W3022749775C86803240 @default.
- W3022749775 hasLocation W30227497751 @default.
- W3022749775 hasOpenAccess W3022749775 @default.
- W3022749775 hasPrimaryLocation W30227497751 @default.
- W3022749775 hasRelatedWork W1486664518 @default.
- W3022749775 hasRelatedWork W1560621288 @default.
- W3022749775 hasRelatedWork W1583675119 @default.