Matches in SemOpenAlex for { <https://semopenalex.org/work/W2897622729> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W2897622729 abstract "We present Nesterov-type acceleration techniques for Alternating Least Squares (ALS) methods applied to canonical tensor decomposition. While Nesterov acceleration turns gradient descent into an optimal first-order method for convex problems by adding a momentum term with a specific weight sequence, a direct application of this method and weight sequence to ALS results in erratic convergence behaviour. This is so because the tensor decomposition problem is non-convex and ALS is accelerated instead of gradient descent. Instead, we consider various restart mechanisms and suitable choices of momentum weights that enable effective acceleration. Our extensive empirical results show that the Nesterov-accelerated ALS methods with restart can be dramatically more efficient than the stand-alone ALS or Nesterov accelerated gradient methods, when problems are ill-conditioned or accurate solutions are desired. The resulting methods perform competitively with or superior to existing acceleration methods for ALS, including ALS acceleration by NCG, NGMRES, or LBFGS, and additionally enjoy the benefit of being much easier to implement. We also compare with Nesterov-type updates where the momentum weight is determined by a line search, which are equivalent or closely related to existing line search methods for ALS. On a large and ill-conditioned 71$times$1000$times$900 tensor consisting of readings from chemical sensors to track hazardous gases, the restarted Nesterov-ALS method shows desirable robustness properties and outperforms any of the existing methods by a large factor. There is clear potential for extending our Nesterov-type acceleration approach to accelerating other optimization algorithms than ALS applied to other non-convex problems, such as Tucker tensor decomposition. Our Matlab code is available at this https URL." @default.
- W2897622729 created "2018-10-26" @default.
- W2897622729 creator A5004247510 @default.
- W2897622729 creator A5023907914 @default.
- W2897622729 creator A5076967157 @default.
- W2897622729 date "2018-10-13" @default.
- W2897622729 modified "2023-09-23" @default.
- W2897622729 title "Nesterov Acceleration of Alternating Least Squares for Canonical Tensor Decomposition" @default.
- W2897622729 hasPublicationYear "2018" @default.
- W2897622729 type Work @default.
- W2897622729 sameAs 2897622729 @default.
- W2897622729 citedByCount "2" @default.
- W2897622729 countsByYear W28976227292019 @default.
- W2897622729 countsByYear W28976227292020 @default.
- W2897622729 crossrefType "posted-content" @default.
- W2897622729 hasAuthorship W2897622729A5004247510 @default.
- W2897622729 hasAuthorship W2897622729A5023907914 @default.
- W2897622729 hasAuthorship W2897622729A5076967157 @default.
- W2897622729 hasConcept C104317684 @default.
- W2897622729 hasConcept C11413529 @default.
- W2897622729 hasConcept C117896860 @default.
- W2897622729 hasConcept C121332964 @default.
- W2897622729 hasConcept C126255220 @default.
- W2897622729 hasConcept C153258448 @default.
- W2897622729 hasConcept C154945302 @default.
- W2897622729 hasConcept C155281189 @default.
- W2897622729 hasConcept C162324750 @default.
- W2897622729 hasConcept C178635117 @default.
- W2897622729 hasConcept C185592680 @default.
- W2897622729 hasConcept C2524010 @default.
- W2897622729 hasConcept C2777303404 @default.
- W2897622729 hasConcept C28826006 @default.
- W2897622729 hasConcept C33923547 @default.
- W2897622729 hasConcept C38652104 @default.
- W2897622729 hasConcept C41008148 @default.
- W2897622729 hasConcept C50522688 @default.
- W2897622729 hasConcept C50644808 @default.
- W2897622729 hasConcept C55493867 @default.
- W2897622729 hasConcept C63479239 @default.
- W2897622729 hasConcept C74650414 @default.
- W2897622729 hasConcept C85522705 @default.
- W2897622729 hasConceptScore W2897622729C104317684 @default.
- W2897622729 hasConceptScore W2897622729C11413529 @default.
- W2897622729 hasConceptScore W2897622729C117896860 @default.
- W2897622729 hasConceptScore W2897622729C121332964 @default.
- W2897622729 hasConceptScore W2897622729C126255220 @default.
- W2897622729 hasConceptScore W2897622729C153258448 @default.
- W2897622729 hasConceptScore W2897622729C154945302 @default.
- W2897622729 hasConceptScore W2897622729C155281189 @default.
- W2897622729 hasConceptScore W2897622729C162324750 @default.
- W2897622729 hasConceptScore W2897622729C178635117 @default.
- W2897622729 hasConceptScore W2897622729C185592680 @default.
- W2897622729 hasConceptScore W2897622729C2524010 @default.
- W2897622729 hasConceptScore W2897622729C2777303404 @default.
- W2897622729 hasConceptScore W2897622729C28826006 @default.
- W2897622729 hasConceptScore W2897622729C33923547 @default.
- W2897622729 hasConceptScore W2897622729C38652104 @default.
- W2897622729 hasConceptScore W2897622729C41008148 @default.
- W2897622729 hasConceptScore W2897622729C50522688 @default.
- W2897622729 hasConceptScore W2897622729C50644808 @default.
- W2897622729 hasConceptScore W2897622729C55493867 @default.
- W2897622729 hasConceptScore W2897622729C63479239 @default.
- W2897622729 hasConceptScore W2897622729C74650414 @default.
- W2897622729 hasConceptScore W2897622729C85522705 @default.
- W2897622729 hasLocation W28976227291 @default.
- W2897622729 hasOpenAccess W2897622729 @default.
- W2897622729 hasPrimaryLocation W28976227291 @default.
- W2897622729 hasRelatedWork W1490376812 @default.
- W2897622729 hasRelatedWork W1981917775 @default.
- W2897622729 hasRelatedWork W2076261573 @default.
- W2897622729 hasRelatedWork W2153749284 @default.
- W2897622729 hasRelatedWork W2473611539 @default.
- W2897622729 hasRelatedWork W2626639528 @default.
- W2897622729 hasRelatedWork W2758543648 @default.
- W2897622729 hasRelatedWork W2765758579 @default.
- W2897622729 hasRelatedWork W2782615409 @default.
- W2897622729 hasRelatedWork W2807915830 @default.
- W2897622729 hasRelatedWork W2951696961 @default.
- W2897622729 hasRelatedWork W2956676323 @default.
- W2897622729 hasRelatedWork W2963487351 @default.
- W2897622729 hasRelatedWork W2963607709 @default.
- W2897622729 hasRelatedWork W2971697083 @default.
- W2897622729 hasRelatedWork W2991474834 @default.
- W2897622729 hasRelatedWork W2996271651 @default.
- W2897622729 hasRelatedWork W3016873192 @default.
- W2897622729 hasRelatedWork W3020737992 @default.
- W2897622729 hasRelatedWork W3100607587 @default.
- W2897622729 isParatext "false" @default.
- W2897622729 isRetracted "false" @default.
- W2897622729 magId "2897622729" @default.
- W2897622729 workType "article" @default.