Matches in SemOpenAlex for { <https://semopenalex.org/work/W3194757396> ?p ?o ?g. }
- W3194757396 abstract "The power method is a classical algorithm with broad applications in machine learning tasks, including streaming PCA, spectral clustering, and low-rank matrix approximation. The distilled purpose of the vanilla power method is to determine the largest eigenvalue (in absolute modulus) and its eigenvector of a matrix. A momentum-based scheme can be used to accelerate the power method, but achieving an optimal convergence rate with existing algorithms critically relies on additional spectral information that is unavailable at run-time, and sub-optimal initializations can result in divergence. In this paper, we provide a pair of novel momentum-based power methods, which we call the delayed momentum power method (DMPower) and a streaming variant, the delayed momentum streaming method (DMStream). Our methods leverage inexact deflation and are capable of achieving near-optimal convergence with far less restrictive hyperparameter requirements. We provide convergence analyses for both algorithms through the lens of perturbation theory. Further, we experimentally demonstrate that DMPower routinely outperforms the vanilla power method and that both algorithms match the convergence speed of an oracle running existing accelerated methods with perfect spectral knowledge." @default.
- W3194757396 created "2021-08-30" @default.
- W3194757396 creator A5008905506 @default.
- W3194757396 creator A5037162168 @default.
- W3194757396 creator A5050503594 @default.
- W3194757396 creator A5066702474 @default.
- W3194757396 date "2021-08-20" @default.
- W3194757396 modified "2023-09-27" @default.
- W3194757396 title "Practical and Fast Momentum-Based Power Methods." @default.
- W3194757396 cites W1576347883 @default.
- W3194757396 cites W1593715786 @default.
- W3194757396 cites W1804110266 @default.
- W3194757396 cites W1988720110 @default.
- W3194757396 cites W2036483645 @default.
- W3194757396 cites W2043969662 @default.
- W3194757396 cites W2053420893 @default.
- W3194757396 cites W2086953401 @default.
- W3194757396 cites W2097417531 @default.
- W3194757396 cites W2097820631 @default.
- W3194757396 cites W2112796928 @default.
- W3194757396 cites W2121947440 @default.
- W3194757396 cites W2137404238 @default.
- W3194757396 cites W2150026392 @default.
- W3194757396 cites W2150593711 @default.
- W3194757396 cites W2166581276 @default.
- W3194757396 cites W2295993392 @default.
- W3194757396 cites W2401095126 @default.
- W3194757396 cites W2432567885 @default.
- W3194757396 cites W2480854438 @default.
- W3194757396 cites W2556206132 @default.
- W3194757396 cites W2741213779 @default.
- W3194757396 cites W2807871202 @default.
- W3194757396 cites W2923400705 @default.
- W3194757396 cites W2963391443 @default.
- W3194757396 cites W2963781962 @default.
- W3194757396 cites W3027666981 @default.
- W3194757396 cites W3037427305 @default.
- W3194757396 cites W3090986099 @default.
- W3194757396 cites W3108405844 @default.
- W3194757396 cites W602955464 @default.
- W3194757396 hasPublicationYear "2021" @default.
- W3194757396 type Work @default.
- W3194757396 sameAs 3194757396 @default.
- W3194757396 citedByCount "0" @default.
- W3194757396 crossrefType "posted-content" @default.
- W3194757396 hasAuthorship W3194757396A5008905506 @default.
- W3194757396 hasAuthorship W3194757396A5037162168 @default.
- W3194757396 hasAuthorship W3194757396A5050503594 @default.
- W3194757396 hasAuthorship W3194757396A5066702474 @default.
- W3194757396 hasConcept C10138342 @default.
- W3194757396 hasConcept C11413529 @default.
- W3194757396 hasConcept C126255220 @default.
- W3194757396 hasConcept C159694833 @default.
- W3194757396 hasConcept C162324750 @default.
- W3194757396 hasConcept C162443888 @default.
- W3194757396 hasConcept C26517878 @default.
- W3194757396 hasConcept C2777303404 @default.
- W3194757396 hasConcept C33923547 @default.
- W3194757396 hasConcept C38652104 @default.
- W3194757396 hasConcept C41008148 @default.
- W3194757396 hasConcept C50522688 @default.
- W3194757396 hasConcept C57869625 @default.
- W3194757396 hasConcept C60718061 @default.
- W3194757396 hasConceptScore W3194757396C10138342 @default.
- W3194757396 hasConceptScore W3194757396C11413529 @default.
- W3194757396 hasConceptScore W3194757396C126255220 @default.
- W3194757396 hasConceptScore W3194757396C159694833 @default.
- W3194757396 hasConceptScore W3194757396C162324750 @default.
- W3194757396 hasConceptScore W3194757396C162443888 @default.
- W3194757396 hasConceptScore W3194757396C26517878 @default.
- W3194757396 hasConceptScore W3194757396C2777303404 @default.
- W3194757396 hasConceptScore W3194757396C33923547 @default.
- W3194757396 hasConceptScore W3194757396C38652104 @default.
- W3194757396 hasConceptScore W3194757396C41008148 @default.
- W3194757396 hasConceptScore W3194757396C50522688 @default.
- W3194757396 hasConceptScore W3194757396C57869625 @default.
- W3194757396 hasConceptScore W3194757396C60718061 @default.
- W3194757396 hasLocation W31947573961 @default.
- W3194757396 hasOpenAccess W3194757396 @default.
- W3194757396 hasPrimaryLocation W31947573961 @default.
- W3194757396 hasRelatedWork W1996258525 @default.
- W3194757396 hasRelatedWork W2016685946 @default.
- W3194757396 hasRelatedWork W2099027195 @default.
- W3194757396 hasRelatedWork W2144044518 @default.
- W3194757396 hasRelatedWork W2292685322 @default.
- W3194757396 hasRelatedWork W2464852223 @default.
- W3194757396 hasRelatedWork W2520529072 @default.
- W3194757396 hasRelatedWork W2621208332 @default.
- W3194757396 hasRelatedWork W2885249296 @default.
- W3194757396 hasRelatedWork W2899900971 @default.
- W3194757396 hasRelatedWork W2937070862 @default.
- W3194757396 hasRelatedWork W2943067977 @default.
- W3194757396 hasRelatedWork W2976168550 @default.
- W3194757396 hasRelatedWork W2989907924 @default.
- W3194757396 hasRelatedWork W3045775977 @default.
- W3194757396 hasRelatedWork W3116882195 @default.
- W3194757396 hasRelatedWork W3162168477 @default.
- W3194757396 hasRelatedWork W3186093828 @default.
- W3194757396 hasRelatedWork W3189787503 @default.
- W3194757396 hasRelatedWork W252502175 @default.