Matches in SemOpenAlex for { <https://semopenalex.org/work/W3040604566> ?p ?o ?g. }
- W3040604566 abstract "Langevin diffusion is a powerful method for nonconvex optimization, which enables the escape from local minima by injecting noise into the gradient. In particular, the temperature parameter controlling the noise level gives rise to a tradeoff between ``global exploration'' and ``local exploitation'', which correspond to high and low temperatures. To attain the advantages of both regimes, we propose to use replica exchange, which swaps between two Langevin diffusions with different temperatures. We theoretically analyze the acceleration effect of replica exchange from two perspectives: (i) the convergence in chi^2-divergence, and (ii) the large deviation principle. Such an acceleration effect allows us to faster approach the global minima. Furthermore, by discretizing the replica exchange Langevin diffusion, we obtain a discrete-time algorithm. For such an algorithm, we quantify its discretization error in theory and demonstrate its acceleration effect in practice." @default.
- W3040604566 created "2020-07-10" @default.
- W3040604566 creator A5015978208 @default.
- W3040604566 creator A5028323106 @default.
- W3040604566 creator A5047373240 @default.
- W3040604566 creator A5078210646 @default.
- W3040604566 creator A5087623559 @default.
- W3040604566 date "2020-07-04" @default.
- W3040604566 modified "2023-10-18" @default.
- W3040604566 title "Accelerating Nonconvex Learning via Replica Exchange Langevin Diffusion" @default.
- W3040604566 cites W1492498476 @default.
- W3040604566 cites W1557040331 @default.
- W3040604566 cites W2003268963 @default.
- W3040604566 cites W2014638390 @default.
- W3040604566 cites W2041898787 @default.
- W3040604566 cites W2043432627 @default.
- W3040604566 cites W2053887662 @default.
- W3040604566 cites W2122385821 @default.
- W3040604566 cites W2136144249 @default.
- W3040604566 cites W2137606648 @default.
- W3040604566 cites W2154061444 @default.
- W3040604566 cites W2171032649 @default.
- W3040604566 cites W2222154095 @default.
- W3040604566 cites W2488096466 @default.
- W3040604566 cites W2736302961 @default.
- W3040604566 cites W2783557135 @default.
- W3040604566 cites W2802739963 @default.
- W3040604566 cites W2962794482 @default.
- W3040604566 cites W2963813262 @default.
- W3040604566 cites W2963870478 @default.
- W3040604566 cites W2964106499 @default.
- W3040604566 cites W423603040 @default.
- W3040604566 hasPublicationYear "2020" @default.
- W3040604566 type Work @default.
- W3040604566 sameAs 3040604566 @default.
- W3040604566 citedByCount "0" @default.
- W3040604566 crossrefType "posted-content" @default.
- W3040604566 hasAuthorship W3040604566A5015978208 @default.
- W3040604566 hasAuthorship W3040604566A5028323106 @default.
- W3040604566 hasAuthorship W3040604566A5047373240 @default.
- W3040604566 hasAuthorship W3040604566A5078210646 @default.
- W3040604566 hasAuthorship W3040604566A5087623559 @default.
- W3040604566 hasConcept C115961682 @default.
- W3040604566 hasConcept C117896860 @default.
- W3040604566 hasConcept C121332964 @default.
- W3040604566 hasConcept C121864883 @default.
- W3040604566 hasConcept C126255220 @default.
- W3040604566 hasConcept C134306372 @default.
- W3040604566 hasConcept C138885662 @default.
- W3040604566 hasConcept C142362112 @default.
- W3040604566 hasConcept C153349607 @default.
- W3040604566 hasConcept C154945302 @default.
- W3040604566 hasConcept C162324750 @default.
- W3040604566 hasConcept C186633575 @default.
- W3040604566 hasConcept C207390915 @default.
- W3040604566 hasConcept C2775937380 @default.
- W3040604566 hasConcept C2777303404 @default.
- W3040604566 hasConcept C2777577648 @default.
- W3040604566 hasConcept C2780004032 @default.
- W3040604566 hasConcept C33923547 @default.
- W3040604566 hasConcept C41008148 @default.
- W3040604566 hasConcept C41895202 @default.
- W3040604566 hasConcept C50522688 @default.
- W3040604566 hasConcept C62520636 @default.
- W3040604566 hasConcept C69357855 @default.
- W3040604566 hasConcept C73000952 @default.
- W3040604566 hasConcept C74650414 @default.
- W3040604566 hasConcept C99498987 @default.
- W3040604566 hasConceptScore W3040604566C115961682 @default.
- W3040604566 hasConceptScore W3040604566C117896860 @default.
- W3040604566 hasConceptScore W3040604566C121332964 @default.
- W3040604566 hasConceptScore W3040604566C121864883 @default.
- W3040604566 hasConceptScore W3040604566C126255220 @default.
- W3040604566 hasConceptScore W3040604566C134306372 @default.
- W3040604566 hasConceptScore W3040604566C138885662 @default.
- W3040604566 hasConceptScore W3040604566C142362112 @default.
- W3040604566 hasConceptScore W3040604566C153349607 @default.
- W3040604566 hasConceptScore W3040604566C154945302 @default.
- W3040604566 hasConceptScore W3040604566C162324750 @default.
- W3040604566 hasConceptScore W3040604566C186633575 @default.
- W3040604566 hasConceptScore W3040604566C207390915 @default.
- W3040604566 hasConceptScore W3040604566C2775937380 @default.
- W3040604566 hasConceptScore W3040604566C2777303404 @default.
- W3040604566 hasConceptScore W3040604566C2777577648 @default.
- W3040604566 hasConceptScore W3040604566C2780004032 @default.
- W3040604566 hasConceptScore W3040604566C33923547 @default.
- W3040604566 hasConceptScore W3040604566C41008148 @default.
- W3040604566 hasConceptScore W3040604566C41895202 @default.
- W3040604566 hasConceptScore W3040604566C50522688 @default.
- W3040604566 hasConceptScore W3040604566C62520636 @default.
- W3040604566 hasConceptScore W3040604566C69357855 @default.
- W3040604566 hasConceptScore W3040604566C73000952 @default.
- W3040604566 hasConceptScore W3040604566C74650414 @default.
- W3040604566 hasConceptScore W3040604566C99498987 @default.
- W3040604566 hasLocation W30406045661 @default.
- W3040604566 hasOpenAccess W3040604566 @default.
- W3040604566 hasPrimaryLocation W30406045661 @default.
- W3040604566 hasRelatedWork W1961674240 @default.
- W3040604566 hasRelatedWork W1998711484 @default.
- W3040604566 hasRelatedWork W2018595752 @default.