Matches in SemOpenAlex for { <https://semopenalex.org/work/W3204548006> ?p ?o ?g. }
- W3204548006 abstract "Three Operator Splitting (TOS) (Davis & Yin, 2017) can minimize the sum of three convex functions effectively when an efficient gradient oracle or proximal operator is available for each term. This requirement often fails in machine learning applications: (i) instead of full gradients only stochastic gradients may be available; and (ii) instead of proximal operators, using subgradients to handle complex penalty functions may be more efficient and realistic. Motivated by these concerns, we analyze three potentially valuable extensions of TOS. The first two permit using subgradients and stochastic gradients, and are shown to ensure a $mathcal{O}(1/sqrt{t})$ convergence rate. The third extension AdapTOS endows TOS with adaptive step-sizes. For the important setting of optimizing a convex loss over the intersection of convex sets AdapTOS attains universal convergence rates, i.e., the rate adapts to the unknown smoothness degree of the objective. We compare our proposed methods with competing methods on various applications." @default.
- W3204548006 created "2021-10-11" @default.
- W3204548006 creator A5015106385 @default.
- W3204548006 creator A5043683448 @default.
- W3204548006 creator A5058767558 @default.
- W3204548006 date "2021-10-07" @default.
- W3204548006 modified "2023-09-27" @default.
- W3204548006 title "Three Operator Splitting with Subgradients, Stochastic Gradients, and Adaptive Learning Rates." @default.
- W3204548006 cites W1518461880 @default.
- W3204548006 cites W1533861849 @default.
- W3204548006 cites W1859634276 @default.
- W3204548006 cites W1981931298 @default.
- W3204548006 cites W1985240368 @default.
- W3204548006 cites W1998991750 @default.
- W3204548006 cites W2030254567 @default.
- W3204548006 cites W205960364 @default.
- W3204548006 cites W2114423093 @default.
- W3204548006 cites W2138019504 @default.
- W3204548006 cites W2143343660 @default.
- W3204548006 cites W2146502635 @default.
- W3204548006 cites W2153635508 @default.
- W3204548006 cites W2153770148 @default.
- W3204548006 cites W2156118598 @default.
- W3204548006 cites W2156387975 @default.
- W3204548006 cites W2167474603 @default.
- W3204548006 cites W2183049114 @default.
- W3204548006 cites W2194775991 @default.
- W3204548006 cites W2241435520 @default.
- W3204548006 cites W2272553923 @default.
- W3204548006 cites W2460144244 @default.
- W3204548006 cites W2510516734 @default.
- W3204548006 cites W2541235961 @default.
- W3204548006 cites W2556092653 @default.
- W3204548006 cites W2618001342 @default.
- W3204548006 cites W2798760781 @default.
- W3204548006 cites W2818059595 @default.
- W3204548006 cites W2913190420 @default.
- W3204548006 cites W2921167833 @default.
- W3204548006 cites W2945983450 @default.
- W3204548006 cites W2962901263 @default.
- W3204548006 cites W2963496223 @default.
- W3204548006 cites W2963630448 @default.
- W3204548006 cites W2963654173 @default.
- W3204548006 cites W2963971976 @default.
- W3204548006 cites W2964150680 @default.
- W3204548006 cites W2964284936 @default.
- W3204548006 cites W2970397609 @default.
- W3204548006 cites W3038041907 @default.
- W3204548006 cites W3141595720 @default.
- W3204548006 cites W3209515688 @default.
- W3204548006 hasPublicationYear "2021" @default.
- W3204548006 type Work @default.
- W3204548006 sameAs 3204548006 @default.
- W3204548006 citedByCount "0" @default.
- W3204548006 crossrefType "posted-content" @default.
- W3204548006 hasAuthorship W3204548006A5015106385 @default.
- W3204548006 hasAuthorship W3204548006A5043683448 @default.
- W3204548006 hasAuthorship W3204548006A5058767558 @default.
- W3204548006 hasConcept C102634674 @default.
- W3204548006 hasConcept C104317684 @default.
- W3204548006 hasConcept C10494615 @default.
- W3204548006 hasConcept C112680207 @default.
- W3204548006 hasConcept C115903868 @default.
- W3204548006 hasConcept C126255220 @default.
- W3204548006 hasConcept C127413603 @default.
- W3204548006 hasConcept C134306372 @default.
- W3204548006 hasConcept C145446738 @default.
- W3204548006 hasConcept C146978453 @default.
- W3204548006 hasConcept C158448853 @default.
- W3204548006 hasConcept C162324750 @default.
- W3204548006 hasConcept C17020691 @default.
- W3204548006 hasConcept C185592680 @default.
- W3204548006 hasConcept C199360897 @default.
- W3204548006 hasConcept C2524010 @default.
- W3204548006 hasConcept C26517878 @default.
- W3204548006 hasConcept C2777303404 @default.
- W3204548006 hasConcept C2778029271 @default.
- W3204548006 hasConcept C28826006 @default.
- W3204548006 hasConcept C33923547 @default.
- W3204548006 hasConcept C38652104 @default.
- W3204548006 hasConcept C41008148 @default.
- W3204548006 hasConcept C50522688 @default.
- W3204548006 hasConcept C55166926 @default.
- W3204548006 hasConcept C55493867 @default.
- W3204548006 hasConcept C57869625 @default.
- W3204548006 hasConcept C64543145 @default.
- W3204548006 hasConcept C86339819 @default.
- W3204548006 hasConceptScore W3204548006C102634674 @default.
- W3204548006 hasConceptScore W3204548006C104317684 @default.
- W3204548006 hasConceptScore W3204548006C10494615 @default.
- W3204548006 hasConceptScore W3204548006C112680207 @default.
- W3204548006 hasConceptScore W3204548006C115903868 @default.
- W3204548006 hasConceptScore W3204548006C126255220 @default.
- W3204548006 hasConceptScore W3204548006C127413603 @default.
- W3204548006 hasConceptScore W3204548006C134306372 @default.
- W3204548006 hasConceptScore W3204548006C145446738 @default.
- W3204548006 hasConceptScore W3204548006C146978453 @default.
- W3204548006 hasConceptScore W3204548006C158448853 @default.
- W3204548006 hasConceptScore W3204548006C162324750 @default.
- W3204548006 hasConceptScore W3204548006C17020691 @default.