Matches in SemOpenAlex for { <https://semopenalex.org/work/W1738389294> ?p ?o ?g. }
- W1738389294 abstract "Energy-based models are popular in machine learning due to the elegance of their formulation and their relationship to statistical physics. Among these, the Restricted Boltzmann Machine (RBM), and its staple training algorithm contrastive divergence (CD), have been the prototype for some recent advancements in the unsupervised training of deep neural networks. However, CD has limited theoretical motivation, and can in some cases produce undesirable behavior. Here, we investigate the performance of Minimum Probability Flow (MPF) learning for training RBMs. Unlike CD, with its focus on approximating an intractable partition function via Gibbs sampling, MPF proposes a tractable, consistent, objective function defined in terms of a Taylor expansion of the KL divergence with respect to sampling dynamics. Here we propose a more general form for the sampling dynamics in MPF, and explore the consequences of different choices for these dynamics for training RBMs. Experimental results show MPF outperforming CD for various RBM configurations." @default.
- W1738389294 created "2016-06-24" @default.
- W1738389294 creator A5034466911 @default.
- W1738389294 creator A5087035079 @default.
- W1738389294 creator A5087700167 @default.
- W1738389294 date "2014-12-20" @default.
- W1738389294 modified "2023-09-27" @default.
- W1738389294 title "Understanding Minimum Probability Flow for RBMs Under Various Kinds of Dynamics" @default.
- W1738389294 cites W1505878979 @default.
- W1738389294 cites W1511867968 @default.
- W1738389294 cites W1606347560 @default.
- W1738389294 cites W1813659000 @default.
- W1738389294 cites W1843615162 @default.
- W1738389294 cites W2096192494 @default.
- W1738389294 cites W2116064496 @default.
- W1738389294 cites W2136796925 @default.
- W1738389294 cites W2138309709 @default.
- W1738389294 cites W2150529939 @default.
- W1738389294 cites W28766783 @default.
- W1738389294 hasPublicationYear "2014" @default.
- W1738389294 type Work @default.
- W1738389294 sameAs 1738389294 @default.
- W1738389294 citedByCount "0" @default.
- W1738389294 crossrefType "posted-content" @default.
- W1738389294 hasAuthorship W1738389294A5034466911 @default.
- W1738389294 hasAuthorship W1738389294A5087035079 @default.
- W1738389294 hasAuthorship W1738389294A5087700167 @default.
- W1738389294 hasConcept C105795698 @default.
- W1738389294 hasConcept C106131492 @default.
- W1738389294 hasConcept C107673813 @default.
- W1738389294 hasConcept C119857082 @default.
- W1738389294 hasConcept C121332964 @default.
- W1738389294 hasConcept C121864883 @default.
- W1738389294 hasConcept C138885662 @default.
- W1738389294 hasConcept C14036430 @default.
- W1738389294 hasConcept C140779682 @default.
- W1738389294 hasConcept C145912823 @default.
- W1738389294 hasConcept C154945302 @default.
- W1738389294 hasConcept C158424031 @default.
- W1738389294 hasConcept C192576344 @default.
- W1738389294 hasConcept C19499675 @default.
- W1738389294 hasConcept C199354608 @default.
- W1738389294 hasConcept C207390915 @default.
- W1738389294 hasConcept C24890656 @default.
- W1738389294 hasConcept C2524010 @default.
- W1738389294 hasConcept C2778401447 @default.
- W1738389294 hasConcept C31972630 @default.
- W1738389294 hasConcept C33923547 @default.
- W1738389294 hasConcept C38349280 @default.
- W1738389294 hasConcept C41008148 @default.
- W1738389294 hasConcept C41895202 @default.
- W1738389294 hasConcept C50644808 @default.
- W1738389294 hasConcept C52740198 @default.
- W1738389294 hasConcept C62520636 @default.
- W1738389294 hasConcept C78458016 @default.
- W1738389294 hasConcept C86803240 @default.
- W1738389294 hasConceptScore W1738389294C105795698 @default.
- W1738389294 hasConceptScore W1738389294C106131492 @default.
- W1738389294 hasConceptScore W1738389294C107673813 @default.
- W1738389294 hasConceptScore W1738389294C119857082 @default.
- W1738389294 hasConceptScore W1738389294C121332964 @default.
- W1738389294 hasConceptScore W1738389294C121864883 @default.
- W1738389294 hasConceptScore W1738389294C138885662 @default.
- W1738389294 hasConceptScore W1738389294C14036430 @default.
- W1738389294 hasConceptScore W1738389294C140779682 @default.
- W1738389294 hasConceptScore W1738389294C145912823 @default.
- W1738389294 hasConceptScore W1738389294C154945302 @default.
- W1738389294 hasConceptScore W1738389294C158424031 @default.
- W1738389294 hasConceptScore W1738389294C192576344 @default.
- W1738389294 hasConceptScore W1738389294C19499675 @default.
- W1738389294 hasConceptScore W1738389294C199354608 @default.
- W1738389294 hasConceptScore W1738389294C207390915 @default.
- W1738389294 hasConceptScore W1738389294C24890656 @default.
- W1738389294 hasConceptScore W1738389294C2524010 @default.
- W1738389294 hasConceptScore W1738389294C2778401447 @default.
- W1738389294 hasConceptScore W1738389294C31972630 @default.
- W1738389294 hasConceptScore W1738389294C33923547 @default.
- W1738389294 hasConceptScore W1738389294C38349280 @default.
- W1738389294 hasConceptScore W1738389294C41008148 @default.
- W1738389294 hasConceptScore W1738389294C41895202 @default.
- W1738389294 hasConceptScore W1738389294C50644808 @default.
- W1738389294 hasConceptScore W1738389294C52740198 @default.
- W1738389294 hasConceptScore W1738389294C62520636 @default.
- W1738389294 hasConceptScore W1738389294C78458016 @default.
- W1738389294 hasConceptScore W1738389294C86803240 @default.
- W1738389294 hasLocation W17383892941 @default.
- W1738389294 hasOpenAccess W1738389294 @default.
- W1738389294 hasPrimaryLocation W17383892941 @default.
- W1738389294 hasRelatedWork W155873922 @default.
- W1738389294 hasRelatedWork W1901467827 @default.
- W1738389294 hasRelatedWork W2010052203 @default.
- W1738389294 hasRelatedWork W2160400687 @default.
- W1738389294 hasRelatedWork W2171282218 @default.
- W1738389294 hasRelatedWork W2337788193 @default.
- W1738389294 hasRelatedWork W2351667571 @default.
- W1738389294 hasRelatedWork W2526882078 @default.
- W1738389294 hasRelatedWork W2769068614 @default.
- W1738389294 hasRelatedWork W2902142523 @default.
- W1738389294 hasRelatedWork W2921407516 @default.
- W1738389294 hasRelatedWork W2964332639 @default.