Matches in SemOpenAlex for { <https://semopenalex.org/work/W3025410163> ?p ?o ?g. }
- W3025410163 abstract "Variational Bayesian inference is an important machine-learning tool that finds application from statistics to robotics. The goal is to find an approximate probability density function (PDF) from a chosen family that is in some sense `closest' to the full Bayesian posterior. Closeness is typically defined through the selection of an appropriate loss functional such as the Kullback-Leibler (KL) divergence. In this paper, we explore a new formulation of variational inference by exploiting the fact that the set of PDFs constitutes a Bayesian Hilbert space under careful definitions of vector addition, scalar multiplication and an inner product. We show that variational inference based on KL divergence then amounts to an iterative projection of the Bayesian posterior onto a subspace corresponding to the selected approximation family. In fact, the inner product chosen for the Bayesian Hilbert space suggests the definition of a new measure of the information contained in a PDF and in turn a new divergence is introduced. Each step in the iterative projection is equivalent to a local minimization of this divergence. We present an example Bayesian subspace based on exponentiated Hermite polynomials as well as work through the details of this general framework for the specific case of the multivariate Gaussian approximation family and show the equivalence to another Gaussian variational inference approach. We furthermore discuss the implications for systems that exhibit sparsity, which is handled naturally in Bayesian space." @default.
- W3025410163 created "2020-05-21" @default.
- W3025410163 creator A5004788089 @default.
- W3025410163 creator A5046792065 @default.
- W3025410163 date "2020-05-14" @default.
- W3025410163 modified "2023-09-27" @default.
- W3025410163 title "Variational Inference as Iterative Projection in a Bayesian Hilbert Space" @default.
- W3025410163 cites W1516111018 @default.
- W3025410163 cites W1557554253 @default.
- W3025410163 cites W1590183771 @default.
- W3025410163 cites W1596933770 @default.
- W3025410163 cites W1965555277 @default.
- W3025410163 cites W1970789124 @default.
- W3025410163 cites W1985768955 @default.
- W3025410163 cites W2009009124 @default.
- W3025410163 cites W2019317784 @default.
- W3025410163 cites W2033468335 @default.
- W3025410163 cites W2047229728 @default.
- W3025410163 cites W2054640142 @default.
- W3025410163 cites W2084840427 @default.
- W3025410163 cites W2098681367 @default.
- W3025410163 cites W2107890688 @default.
- W3025410163 cites W2120340025 @default.
- W3025410163 cites W2122512809 @default.
- W3025410163 cites W2124098876 @default.
- W3025410163 cites W2137796859 @default.
- W3025410163 cites W2147940467 @default.
- W3025410163 cites W2154865683 @default.
- W3025410163 cites W2160709761 @default.
- W3025410163 cites W2745007981 @default.
- W3025410163 cites W2946265133 @default.
- W3025410163 cites W2962738371 @default.
- W3025410163 cites W2964318004 @default.
- W3025410163 cites W2995615678 @default.
- W3025410163 cites W3003789643 @default.
- W3025410163 cites W3045993716 @default.
- W3025410163 cites W3083113686 @default.
- W3025410163 cites W3083479980 @default.
- W3025410163 cites W3142743920 @default.
- W3025410163 cites W3193262203 @default.
- W3025410163 cites W601322211 @default.
- W3025410163 hasPublicationYear "2020" @default.
- W3025410163 type Work @default.
- W3025410163 sameAs 3025410163 @default.
- W3025410163 citedByCount "1" @default.
- W3025410163 countsByYear W30254101632020 @default.
- W3025410163 crossrefType "posted-content" @default.
- W3025410163 hasAuthorship W3025410163A5004788089 @default.
- W3025410163 hasAuthorship W3025410163A5046792065 @default.
- W3025410163 hasConcept C105795698 @default.
- W3025410163 hasConcept C107673813 @default.
- W3025410163 hasConcept C11413529 @default.
- W3025410163 hasConcept C126255220 @default.
- W3025410163 hasConcept C134306372 @default.
- W3025410163 hasConcept C138885662 @default.
- W3025410163 hasConcept C154945302 @default.
- W3025410163 hasConcept C160234255 @default.
- W3025410163 hasConcept C171752962 @default.
- W3025410163 hasConcept C207390915 @default.
- W3025410163 hasConcept C2776214188 @default.
- W3025410163 hasConcept C28826006 @default.
- W3025410163 hasConcept C32834561 @default.
- W3025410163 hasConcept C33923547 @default.
- W3025410163 hasConcept C41008148 @default.
- W3025410163 hasConcept C41895202 @default.
- W3025410163 hasConcept C57493831 @default.
- W3025410163 hasConcept C62799726 @default.
- W3025410163 hasConceptScore W3025410163C105795698 @default.
- W3025410163 hasConceptScore W3025410163C107673813 @default.
- W3025410163 hasConceptScore W3025410163C11413529 @default.
- W3025410163 hasConceptScore W3025410163C126255220 @default.
- W3025410163 hasConceptScore W3025410163C134306372 @default.
- W3025410163 hasConceptScore W3025410163C138885662 @default.
- W3025410163 hasConceptScore W3025410163C154945302 @default.
- W3025410163 hasConceptScore W3025410163C160234255 @default.
- W3025410163 hasConceptScore W3025410163C171752962 @default.
- W3025410163 hasConceptScore W3025410163C207390915 @default.
- W3025410163 hasConceptScore W3025410163C2776214188 @default.
- W3025410163 hasConceptScore W3025410163C28826006 @default.
- W3025410163 hasConceptScore W3025410163C32834561 @default.
- W3025410163 hasConceptScore W3025410163C33923547 @default.
- W3025410163 hasConceptScore W3025410163C41008148 @default.
- W3025410163 hasConceptScore W3025410163C41895202 @default.
- W3025410163 hasConceptScore W3025410163C57493831 @default.
- W3025410163 hasConceptScore W3025410163C62799726 @default.
- W3025410163 hasLocation W30254101631 @default.
- W3025410163 hasOpenAccess W3025410163 @default.
- W3025410163 hasPrimaryLocation W30254101631 @default.
- W3025410163 hasRelatedWork W1534145347 @default.
- W3025410163 hasRelatedWork W1583413201 @default.
- W3025410163 hasRelatedWork W1629302677 @default.
- W3025410163 hasRelatedWork W1809333115 @default.
- W3025410163 hasRelatedWork W1969408578 @default.
- W3025410163 hasRelatedWork W2055033223 @default.
- W3025410163 hasRelatedWork W2094008768 @default.
- W3025410163 hasRelatedWork W2113115392 @default.
- W3025410163 hasRelatedWork W214291446 @default.
- W3025410163 hasRelatedWork W2167174409 @default.
- W3025410163 hasRelatedWork W2243234527 @default.
- W3025410163 hasRelatedWork W2481701519 @default.