FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3091782125> ?p ?o ?g. }

• W3091782125 abstract "Optimistic Gradient Descent Ascent (OGDA) and Optimistic Multiplicative Weights Update (OMWU) for saddle-point optimization have received growing attention due to their favorable last-iterate convergence. However, their behaviors for simple bilinear games over the probability simplex are still not fully understood - previous analysis lacks explicit convergence rates, only applies to an exponentially small learning rate, or requires additional assumptions such as the uniqueness of the optimal solution. In this work, we significantly expand the understanding of last-iterate convergence for OGDA and OMWU in the constrained setting. Specifically, for OMWU in bilinear games over the simplex, we show that when the equilibrium is unique, linear last-iterate convergence is achieved with a learning rate whose value is set to a universal constant, improving the result of (Daskalakis & Panageas, 2019b) under the same assumption. We then significantly extend the results to more general objectives and feasible sets for the projected OGDA algorithm, by introducing a sufficient condition under which OGDA exhibits concrete last-iterate convergence rates with a constant learning rate whose value only depends on the smoothness of the objective function. We show that bilinear games over any polytope satisfy this condition and OGDA converges exponentially fast even without the unique equilibrium assumption. Our condition also holds for strongly-convex-strongly-concave functions, recovering the result of (Hsieh et al., 2019). Finally, we provide experimental results to further support our theory." @default.
• W3091782125 created "2020-10-15" @default.
• W3091782125 creator A5035849375 @default.
• W3091782125 creator A5047592896 @default.
• W3091782125 creator A5049895708 @default.
• W3091782125 creator A5081436006 @default.
• W3091782125 date "2020-06-16" @default.
• W3091782125 modified "2023-09-27" @default.
• W3091782125 title "Linear Last-iterate Convergence in Constrained Saddle-point Optimization" @default.
• W3091782125 cites W1489128386 @default.
• W3091782125 cites W1664501243 @default.
• W3091782125 cites W1856231595 @default.
• W3091782125 cites W2010134289 @default.
• W3091782125 cites W2049337234 @default.
• W3091782125 cites W2073584813 @default.
• W3091782125 cites W2075226379 @default.
• W3091782125 cites W2075567596 @default.
• W3091782125 cites W2081985785 @default.
• W3091782125 cites W2082451773 @default.
• W3091782125 cites W2093246563 @default.
• W3091782125 cites W2093417350 @default.
• W3091782125 cites W2099471712 @default.
• W3091782125 cites W2106887613 @default.
• W3091782125 cites W2138362680 @default.
• W3091782125 cites W2139192858 @default.
• W3091782125 cites W2143343660 @default.
• W3091782125 cites W2186453173 @default.
• W3091782125 cites W2568744357 @default.
• W3091782125 cites W2593248927 @default.
• W3091782125 cites W2811481615 @default.
• W3091782125 cites W2894677249 @default.
• W3091782125 cites W2962823973 @default.
• W3091782125 cites W2963147599 @default.
• W3091782125 cites W2963213190 @default.
• W3091782125 cites W2963297691 @default.
• W3091782125 cites W2963647223 @default.
• W3091782125 cites W2964067523 @default.
• W3091782125 cites W2964070557 @default.
• W3091782125 cites W2964249351 @default.
• W3091782125 cites W2964334726 @default.
• W3091782125 cites W2965900084 @default.
• W3091782125 cites W2966213063 @default.
• W3091782125 cites W2971302301 @default.
• W3091782125 cites W2987616811 @default.
• W3091782125 cites W3006559823 @default.
• W3091782125 cites W3037593317 @default.
• W3091782125 cites W3037721576 @default.
• W3091782125 cites W3046366290 @default.
• W3091782125 cites W3046748628 @default.
• W3091782125 cites W3098384494 @default.
• W3091782125 cites W3098595117 @default.
• W3091782125 cites W3098722856 @default.
• W3091782125 cites W3101497372 @default.
• W3091782125 hasPublicationYear "2020" @default.
• W3091782125 type Work @default.
• W3091782125 sameAs 3091782125 @default.
• W3091782125 citedByCount "0" @default.
• W3091782125 crossrefType "posted-content" @default.
• W3091782125 hasAuthorship W3091782125A5035849375 @default.
• W3091782125 hasAuthorship W3091782125A5047592896 @default.
• W3091782125 hasAuthorship W3091782125A5049895708 @default.
• W3091782125 hasAuthorship W3091782125A5081436006 @default.
• W3091782125 hasConcept C102634674 @default.
• W3091782125 hasConcept C112680207 @default.
• W3091782125 hasConcept C114614502 @default.
• W3091782125 hasConcept C126255220 @default.
• W3091782125 hasConcept C127162648 @default.
• W3091782125 hasConcept C134306372 @default.
• W3091782125 hasConcept C145446738 @default.
• W3091782125 hasConcept C145691206 @default.
• W3091782125 hasConcept C162324750 @default.
• W3091782125 hasConcept C199360897 @default.
• W3091782125 hasConcept C2524010 @default.
• W3091782125 hasConcept C2681867 @default.
• W3091782125 hasConcept C2777021972 @default.
• W3091782125 hasConcept C2777027219 @default.
• W3091782125 hasConcept C2777303404 @default.
• W3091782125 hasConcept C28826006 @default.
• W3091782125 hasConcept C31258907 @default.
• W3091782125 hasConcept C33923547 @default.
• W3091782125 hasConcept C41008148 @default.
• W3091782125 hasConcept C50522688 @default.
• W3091782125 hasConcept C57869625 @default.
• W3091782125 hasConcept C62438384 @default.
• W3091782125 hasConceptScore W3091782125C102634674 @default.
• W3091782125 hasConceptScore W3091782125C112680207 @default.
• W3091782125 hasConceptScore W3091782125C114614502 @default.
• W3091782125 hasConceptScore W3091782125C126255220 @default.
• W3091782125 hasConceptScore W3091782125C127162648 @default.
• W3091782125 hasConceptScore W3091782125C134306372 @default.
• W3091782125 hasConceptScore W3091782125C145446738 @default.
• W3091782125 hasConceptScore W3091782125C145691206 @default.
• W3091782125 hasConceptScore W3091782125C162324750 @default.
• W3091782125 hasConceptScore W3091782125C199360897 @default.
• W3091782125 hasConceptScore W3091782125C2524010 @default.
• W3091782125 hasConceptScore W3091782125C2681867 @default.
• W3091782125 hasConceptScore W3091782125C2777021972 @default.
• W3091782125 hasConceptScore W3091782125C2777027219 @default.
• W3091782125 hasConceptScore W3091782125C2777303404 @default.
• W3091782125 hasConceptScore W3091782125C28826006 @default.

• next