Matches in SemOpenAlex for { <https://semopenalex.org/work/W3118809778> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W3118809778 abstract "In this paper, we study the minimax optimization problem in the smooth and strongly convex-strongly concave setting when we have access to noisy estimates of gradients. In particular, we first analyze the stochastic Gradient Descent Ascent (GDA) method with constant stepsize, and show that it converges to a neighborhood of the solution of the minimax problem. We further provide tight bounds on the convergence rate and the size of this neighborhood. Next, we propose a multistage variant of stochastic GDA (M-GDA) that runs in multiple stages with a particular learning rate decay schedule and converges to the exact solution of the minimax problem. We show M-GDA achieves the lower bounds in terms of noise dependence without any assumptions on the knowledge of noise characteristics. We also show that M-GDA obtains a linear decay rate with respect to the error's dependence on the initial error, although the dependence on condition number is suboptimal. In order to improve this dependence, we apply the multistage machinery to the stochastic Optimistic Gradient Descent Ascent (OGDA) algorithm and propose the M-OGDA algorithm which also achieves the optimal linear decay rate with respect to the initial error. To the best of our knowledge, this method is the first to simultaneously achieve the best dependence on noise characteristic as well as the initial error and condition number." @default.
- W3118809778 created "2021-01-18" @default.
- W3118809778 creator A5016741616 @default.
- W3118809778 creator A5053188368 @default.
- W3118809778 creator A5067307504 @default.
- W3118809778 date "2020-12-14" @default.
- W3118809778 modified "2023-10-16" @default.
- W3118809778 title "An Optimal Multistage Stochastic Gradient Method for Minimax Problems" @default.
- W3118809778 cites W1992208280 @default.
- W3118809778 cites W2045744861 @default.
- W3118809778 cites W2092851214 @default.
- W3118809778 cites W2124541940 @default.
- W3118809778 cites W2155192981 @default.
- W3118809778 cites W2168909589 @default.
- W3118809778 cites W2593248927 @default.
- W3118809778 cites W2964102336 @default.
- W3118809778 cites W2964121860 @default.
- W3118809778 cites W3008463948 @default.
- W3118809778 cites W3118809778 @default.
- W3118809778 doi "https://doi.org/10.1109/cdc42340.2020.9304033" @default.
- W3118809778 hasPublicationYear "2020" @default.
- W3118809778 type Work @default.
- W3118809778 sameAs 3118809778 @default.
- W3118809778 citedByCount "5" @default.
- W3118809778 countsByYear W31188097782020 @default.
- W3118809778 countsByYear W31188097782021 @default.
- W3118809778 countsByYear W31188097782022 @default.
- W3118809778 countsByYear W31188097782023 @default.
- W3118809778 crossrefType "proceedings-article" @default.
- W3118809778 hasAuthorship W3118809778A5016741616 @default.
- W3118809778 hasAuthorship W3118809778A5053188368 @default.
- W3118809778 hasAuthorship W3118809778A5067307504 @default.
- W3118809778 hasBestOaLocation W31188097782 @default.
- W3118809778 hasConcept C111919701 @default.
- W3118809778 hasConcept C115961682 @default.
- W3118809778 hasConcept C119857082 @default.
- W3118809778 hasConcept C126255220 @default.
- W3118809778 hasConcept C127162648 @default.
- W3118809778 hasConcept C149728462 @default.
- W3118809778 hasConcept C153258448 @default.
- W3118809778 hasConcept C154945302 @default.
- W3118809778 hasConcept C162324750 @default.
- W3118809778 hasConcept C199360897 @default.
- W3118809778 hasConcept C206688291 @default.
- W3118809778 hasConcept C2777027219 @default.
- W3118809778 hasConcept C2777303404 @default.
- W3118809778 hasConcept C28826006 @default.
- W3118809778 hasConcept C31258907 @default.
- W3118809778 hasConcept C33923547 @default.
- W3118809778 hasConcept C41008148 @default.
- W3118809778 hasConcept C50522688 @default.
- W3118809778 hasConcept C50644808 @default.
- W3118809778 hasConcept C57869625 @default.
- W3118809778 hasConcept C68387754 @default.
- W3118809778 hasConcept C99498987 @default.
- W3118809778 hasConceptScore W3118809778C111919701 @default.
- W3118809778 hasConceptScore W3118809778C115961682 @default.
- W3118809778 hasConceptScore W3118809778C119857082 @default.
- W3118809778 hasConceptScore W3118809778C126255220 @default.
- W3118809778 hasConceptScore W3118809778C127162648 @default.
- W3118809778 hasConceptScore W3118809778C149728462 @default.
- W3118809778 hasConceptScore W3118809778C153258448 @default.
- W3118809778 hasConceptScore W3118809778C154945302 @default.
- W3118809778 hasConceptScore W3118809778C162324750 @default.
- W3118809778 hasConceptScore W3118809778C199360897 @default.
- W3118809778 hasConceptScore W3118809778C206688291 @default.
- W3118809778 hasConceptScore W3118809778C2777027219 @default.
- W3118809778 hasConceptScore W3118809778C2777303404 @default.
- W3118809778 hasConceptScore W3118809778C28826006 @default.
- W3118809778 hasConceptScore W3118809778C31258907 @default.
- W3118809778 hasConceptScore W3118809778C33923547 @default.
- W3118809778 hasConceptScore W3118809778C41008148 @default.
- W3118809778 hasConceptScore W3118809778C50522688 @default.
- W3118809778 hasConceptScore W3118809778C50644808 @default.
- W3118809778 hasConceptScore W3118809778C57869625 @default.
- W3118809778 hasConceptScore W3118809778C68387754 @default.
- W3118809778 hasConceptScore W3118809778C99498987 @default.
- W3118809778 hasLocation W31188097781 @default.
- W3118809778 hasLocation W31188097782 @default.
- W3118809778 hasLocation W31188097783 @default.
- W3118809778 hasOpenAccess W3118809778 @default.
- W3118809778 hasPrimaryLocation W31188097781 @default.
- W3118809778 hasRelatedWork W2349504429 @default.
- W3118809778 hasRelatedWork W2766590049 @default.
- W3118809778 hasRelatedWork W2979647660 @default.
- W3118809778 hasRelatedWork W3002546633 @default.
- W3118809778 hasRelatedWork W3007279825 @default.
- W3118809778 hasRelatedWork W3045679877 @default.
- W3118809778 hasRelatedWork W3102816259 @default.
- W3118809778 hasRelatedWork W4313591702 @default.
- W3118809778 hasRelatedWork W4380358855 @default.
- W3118809778 hasRelatedWork W4385327721 @default.
- W3118809778 isParatext "false" @default.
- W3118809778 isRetracted "false" @default.
- W3118809778 magId "3118809778" @default.
- W3118809778 workType "article" @default.