Matches in SemOpenAlex for { <https://semopenalex.org/work/W2950413897> ?p ?o ?g. }
- W2950413897 abstract "Stochastic variational inference (SVI) lets us scale up Bayesian computation to massive data. It uses stochastic optimization to fit a variational distribution, following easy-to-compute noisy natural gradients. As with most traditional stochastic optimization methods, SVI takes precautions to use unbiased stochastic gradients whose expectations are equal to the true gradients. In this paper, we explore the idea of following biased stochastic gradients in SVI. Our method replaces the natural gradient with a similarly constructed vector that uses a fixed-window moving average of some of its previous terms. We will demonstrate the many advantages of this technique. First, its computational cost is the same as for SVI and storage requirements only multiply by a constant factor. Second, it enjoys significant variance reduction over the unbiased estimates, smaller bias than averaged gradients, and leads to smaller mean-squared error against the full gradient. We test our method on latent Dirichlet allocation with three large corpora." @default.
- W2950413897 created "2019-06-27" @default.
- W2950413897 creator A5036302820 @default.
- W2950413897 creator A5070920982 @default.
- W2950413897 date "2014-06-13" @default.
- W2950413897 modified "2023-09-27" @default.
- W2950413897 title "Smoothed Gradients for Stochastic Variational Inference" @default.
- W2950413897 cites W1777124189 @default.
- W2950413897 cites W1880262756 @default.
- W2950413897 cites W1994616650 @default.
- W2950413897 cites W2061863621 @default.
- W2950413897 cites W2066828202 @default.
- W2950413897 cites W2107107106 @default.
- W2950413897 cites W2107438106 @default.
- W2950413897 cites W2120340025 @default.
- W2950413897 cites W2123528936 @default.
- W2950413897 cites W2165599843 @default.
- W2950413897 cites W2166851633 @default.
- W2950413897 cites W2169713291 @default.
- W2950413897 cites W2171911691 @default.
- W2950413897 cites W86282824 @default.
- W2950413897 hasPublicationYear "2014" @default.
- W2950413897 type Work @default.
- W2950413897 sameAs 2950413897 @default.
- W2950413897 citedByCount "12" @default.
- W2950413897 countsByYear W29504138972014 @default.
- W2950413897 countsByYear W29504138972015 @default.
- W2950413897 countsByYear W29504138972017 @default.
- W2950413897 countsByYear W29504138972018 @default.
- W2950413897 countsByYear W29504138972020 @default.
- W2950413897 countsByYear W29504138972021 @default.
- W2950413897 crossrefType "posted-content" @default.
- W2950413897 hasAuthorship W2950413897A5036302820 @default.
- W2950413897 hasAuthorship W2950413897A5070920982 @default.
- W2950413897 hasConcept C105795698 @default.
- W2950413897 hasConcept C107673813 @default.
- W2950413897 hasConcept C11413529 @default.
- W2950413897 hasConcept C121955636 @default.
- W2950413897 hasConcept C126255220 @default.
- W2950413897 hasConcept C134306372 @default.
- W2950413897 hasConcept C144133560 @default.
- W2950413897 hasConcept C154945302 @default.
- W2950413897 hasConcept C160234255 @default.
- W2950413897 hasConcept C169214877 @default.
- W2950413897 hasConcept C182310444 @default.
- W2950413897 hasConcept C194387892 @default.
- W2950413897 hasConcept C196083921 @default.
- W2950413897 hasConcept C199360897 @default.
- W2950413897 hasConcept C2776214188 @default.
- W2950413897 hasConcept C2777027219 @default.
- W2950413897 hasConcept C28826006 @default.
- W2950413897 hasConcept C33923547 @default.
- W2950413897 hasConcept C41008148 @default.
- W2950413897 hasConcept C45374587 @default.
- W2950413897 hasConceptScore W2950413897C105795698 @default.
- W2950413897 hasConceptScore W2950413897C107673813 @default.
- W2950413897 hasConceptScore W2950413897C11413529 @default.
- W2950413897 hasConceptScore W2950413897C121955636 @default.
- W2950413897 hasConceptScore W2950413897C126255220 @default.
- W2950413897 hasConceptScore W2950413897C134306372 @default.
- W2950413897 hasConceptScore W2950413897C144133560 @default.
- W2950413897 hasConceptScore W2950413897C154945302 @default.
- W2950413897 hasConceptScore W2950413897C160234255 @default.
- W2950413897 hasConceptScore W2950413897C169214877 @default.
- W2950413897 hasConceptScore W2950413897C182310444 @default.
- W2950413897 hasConceptScore W2950413897C194387892 @default.
- W2950413897 hasConceptScore W2950413897C196083921 @default.
- W2950413897 hasConceptScore W2950413897C199360897 @default.
- W2950413897 hasConceptScore W2950413897C2776214188 @default.
- W2950413897 hasConceptScore W2950413897C2777027219 @default.
- W2950413897 hasConceptScore W2950413897C28826006 @default.
- W2950413897 hasConceptScore W2950413897C33923547 @default.
- W2950413897 hasConceptScore W2950413897C41008148 @default.
- W2950413897 hasConceptScore W2950413897C45374587 @default.
- W2950413897 hasLocation W29504138971 @default.
- W2950413897 hasOpenAccess W2950413897 @default.
- W2950413897 hasPrimaryLocation W29504138971 @default.
- W2950413897 hasRelatedWork W1509040904 @default.
- W2950413897 hasRelatedWork W1516111018 @default.
- W2950413897 hasRelatedWork W1880262756 @default.
- W2950413897 hasRelatedWork W1994616650 @default.
- W2950413897 hasRelatedWork W2030745897 @default.
- W2950413897 hasRelatedWork W2047230031 @default.
- W2950413897 hasRelatedWork W2056760934 @default.
- W2950413897 hasRelatedWork W2124905705 @default.
- W2950413897 hasRelatedWork W2146502635 @default.
- W2950413897 hasRelatedWork W2148721460 @default.
- W2950413897 hasRelatedWork W2166851633 @default.
- W2950413897 hasRelatedWork W2418128690 @default.
- W2950413897 hasRelatedWork W2763836425 @default.
- W2950413897 hasRelatedWork W2892457101 @default.
- W2950413897 hasRelatedWork W2963173382 @default.
- W2950413897 hasRelatedWork W2966734222 @default.
- W2950413897 hasRelatedWork W3011226793 @default.
- W2950413897 hasRelatedWork W3027080454 @default.
- W2950413897 hasRelatedWork W3101100385 @default.
- W2950413897 hasRelatedWork W1569602402 @default.
- W2950413897 isParatext "false" @default.
- W2950413897 isRetracted "false" @default.
- W2950413897 magId "2950413897" @default.