Matches in SemOpenAlex for { <https://semopenalex.org/work/W2913750528> ?p ?o ?g. }
- W2913750528 abstract "The (stochastic) gradient descent and the multiplicative update method are probably the most popular algorithms in machine learning. We introduce and study a new regularization which provides a unification of the additive and multiplicative updates. This regularization is derived from an hyperbolic analogue of the entropy function, which we call hypentropy. It is motivated by a natural extension of the multiplicative update to negative numbers. The hypentropy has a natural spectral counterpart which we use to derive a family of matrix-based updates that bridge gradient methods and the multiplicative method for matrices. While the latter is only applicable to positive semi-definite matrices, the spectral hypentropy method can naturally be used with general rectangular matrices. We analyze the new family of updates by deriving tight regret bounds. We study empirically the applicability of the new update for settings such as multiclass learning, in which the parameters constitute a general rectangular matrix." @default.
- W2913750528 created "2019-02-21" @default.
- W2913750528 creator A5017544719 @default.
- W2913750528 creator A5024431603 @default.
- W2913750528 creator A5050591232 @default.
- W2913750528 date "2019-02-05" @default.
- W2913750528 modified "2023-09-27" @default.
- W2913750528 title "Exponentiated Gradient Meets Gradient Descent" @default.
- W2913750528 cites W1537145174 @default.
- W2913750528 cites W1540586255 @default.
- W2913750528 cites W1570963478 @default.
- W2913750528 cites W1575259140 @default.
- W2913750528 cites W1786935204 @default.
- W2913750528 cites W1995547833 @default.
- W2913750528 cites W2069317438 @default.
- W2913750528 cites W2077723394 @default.
- W2913750528 cites W2102800374 @default.
- W2913750528 cites W2109339818 @default.
- W2913750528 cites W2146502635 @default.
- W2913750528 cites W2150865801 @default.
- W2913750528 cites W2170912114 @default.
- W2913750528 cites W2293569770 @default.
- W2913750528 cites W2513180554 @default.
- W2913750528 cites W2606082375 @default.
- W2913750528 cites W3118608800 @default.
- W2913750528 hasPublicationYear "2019" @default.
- W2913750528 type Work @default.
- W2913750528 sameAs 2913750528 @default.
- W2913750528 citedByCount "3" @default.
- W2913750528 countsByYear W29137505282019 @default.
- W2913750528 countsByYear W29137505282020 @default.
- W2913750528 crossrefType "posted-content" @default.
- W2913750528 hasAuthorship W2913750528A5017544719 @default.
- W2913750528 hasAuthorship W2913750528A5024431603 @default.
- W2913750528 hasAuthorship W2913750528A5050591232 @default.
- W2913750528 hasConcept C105795698 @default.
- W2913750528 hasConcept C106301342 @default.
- W2913750528 hasConcept C106487976 @default.
- W2913750528 hasConcept C11413529 @default.
- W2913750528 hasConcept C121332964 @default.
- W2913750528 hasConcept C126255220 @default.
- W2913750528 hasConcept C134306372 @default.
- W2913750528 hasConcept C153258448 @default.
- W2913750528 hasConcept C154945302 @default.
- W2913750528 hasConcept C159985019 @default.
- W2913750528 hasConcept C192562407 @default.
- W2913750528 hasConcept C206688291 @default.
- W2913750528 hasConcept C2776135515 @default.
- W2913750528 hasConcept C28826006 @default.
- W2913750528 hasConcept C33923547 @default.
- W2913750528 hasConcept C41008148 @default.
- W2913750528 hasConcept C42747912 @default.
- W2913750528 hasConcept C50644808 @default.
- W2913750528 hasConcept C50817715 @default.
- W2913750528 hasConcept C62520636 @default.
- W2913750528 hasConceptScore W2913750528C105795698 @default.
- W2913750528 hasConceptScore W2913750528C106301342 @default.
- W2913750528 hasConceptScore W2913750528C106487976 @default.
- W2913750528 hasConceptScore W2913750528C11413529 @default.
- W2913750528 hasConceptScore W2913750528C121332964 @default.
- W2913750528 hasConceptScore W2913750528C126255220 @default.
- W2913750528 hasConceptScore W2913750528C134306372 @default.
- W2913750528 hasConceptScore W2913750528C153258448 @default.
- W2913750528 hasConceptScore W2913750528C154945302 @default.
- W2913750528 hasConceptScore W2913750528C159985019 @default.
- W2913750528 hasConceptScore W2913750528C192562407 @default.
- W2913750528 hasConceptScore W2913750528C206688291 @default.
- W2913750528 hasConceptScore W2913750528C2776135515 @default.
- W2913750528 hasConceptScore W2913750528C28826006 @default.
- W2913750528 hasConceptScore W2913750528C33923547 @default.
- W2913750528 hasConceptScore W2913750528C41008148 @default.
- W2913750528 hasConceptScore W2913750528C42747912 @default.
- W2913750528 hasConceptScore W2913750528C50644808 @default.
- W2913750528 hasConceptScore W2913750528C50817715 @default.
- W2913750528 hasConceptScore W2913750528C62520636 @default.
- W2913750528 hasLocation W29137505281 @default.
- W2913750528 hasOpenAccess W2913750528 @default.
- W2913750528 hasPrimaryLocation W29137505281 @default.
- W2913750528 hasRelatedWork W114365322 @default.
- W2913750528 hasRelatedWork W1508694032 @default.
- W2913750528 hasRelatedWork W1526299531 @default.
- W2913750528 hasRelatedWork W2054954154 @default.
- W2913750528 hasRelatedWork W2136495462 @default.
- W2913750528 hasRelatedWork W2309015396 @default.
- W2913750528 hasRelatedWork W2561976564 @default.
- W2913750528 hasRelatedWork W2562193914 @default.
- W2913750528 hasRelatedWork W2562229278 @default.
- W2913750528 hasRelatedWork W2795636162 @default.
- W2913750528 hasRelatedWork W2801503411 @default.
- W2913750528 hasRelatedWork W2914786990 @default.
- W2913750528 hasRelatedWork W2951197689 @default.
- W2913750528 hasRelatedWork W2962702650 @default.
- W2913750528 hasRelatedWork W2962898620 @default.
- W2913750528 hasRelatedWork W2963774283 @default.
- W2913750528 hasRelatedWork W3037347970 @default.
- W2913750528 hasRelatedWork W3113667615 @default.
- W2913750528 hasRelatedWork W3152501190 @default.
- W2913750528 hasRelatedWork W3037047039 @default.
- W2913750528 isParatext "false" @default.
- W2913750528 isRetracted "false" @default.