Matches in SemOpenAlex for { <https://semopenalex.org/work/W3013634249> ?p ?o ?g. }
- W3013634249 abstract "We study a class of nonconvex-strongly-concave min-max optimization problems. A most commonly used algorithm for such problems in machine learning applications is the class of first-order algorithms where gradient descent and ascent steps are performed simultaneously or alternatively in each step. Despite its great success in practice, its theoretical properties are far from being understood. In fact, not much has been said about its convergence once the convex-concave assumption is absent. This is considerably different from minimization problems where many techniques are available to analyze nonconvex problems. It is not clear that if these techniques can be applied to min-max optimization. Despite the simplicity of this type of first-order methods, its properties are extremely difficult to analyze due to the nonlinear and nonconvex coupling between the maximization and minimization steps.(p)(/p)In this paper, we take a step toward this direction by examining a special class of nonconvex-strongly-concave min-max problems. We show that, with a proper stepsize choice, a simple alternating gradient descent/ascent (AGDA) algorithm would, in fact, converge to a stationary solution with a sublinear rate $mathcal{O}left( {1/t} right)$, where t is the iteration number. We hope our analysis sheds light on future studies on the theoretical properties of relevant machine learning problems." @default.
- W3013634249 created "2020-04-03" @default.
- W3013634249 creator A5016900183 @default.
- W3013634249 creator A5049896980 @default.
- W3013634249 creator A5066940107 @default.
- W3013634249 creator A5074776692 @default.
- W3013634249 creator A5088593720 @default.
- W3013634249 date "2019-11-01" @default.
- W3013634249 modified "2023-09-25" @default.
- W3013634249 title "Alternating Gradient Descent Ascent for Nonconvex Min-Max Problems in Robust Learning and GANs" @default.
- W3013634249 cites W2092851214 @default.
- W3013634249 cites W2099471712 @default.
- W3013634249 cites W2112796928 @default.
- W3013634249 cites W2163605009 @default.
- W3013634249 cites W2173520492 @default.
- W3013634249 cites W2564590721 @default.
- W3013634249 cites W2619503996 @default.
- W3013634249 cites W2766210095 @default.
- W3013634249 cites W2791323206 @default.
- W3013634249 cites W2803117117 @default.
- W3013634249 cites W2895628298 @default.
- W3013634249 cites W2963049063 @default.
- W3013634249 cites W2963508732 @default.
- W3013634249 cites W2964018346 @default.
- W3013634249 cites W2964126461 @default.
- W3013634249 cites W2964253222 @default.
- W3013634249 cites W2964334726 @default.
- W3013634249 cites W3016604587 @default.
- W3013634249 doi "https://doi.org/10.1109/ieeeconf44664.2019.9048943" @default.
- W3013634249 hasPublicationYear "2019" @default.
- W3013634249 type Work @default.
- W3013634249 sameAs 3013634249 @default.
- W3013634249 citedByCount "2" @default.
- W3013634249 countsByYear W30136342492020 @default.
- W3013634249 crossrefType "proceedings-article" @default.
- W3013634249 hasAuthorship W3013634249A5016900183 @default.
- W3013634249 hasAuthorship W3013634249A5049896980 @default.
- W3013634249 hasAuthorship W3013634249A5066940107 @default.
- W3013634249 hasAuthorship W3013634249A5074776692 @default.
- W3013634249 hasAuthorship W3013634249A5088593720 @default.
- W3013634249 hasConcept C112680207 @default.
- W3013634249 hasConcept C114614502 @default.
- W3013634249 hasConcept C116149140 @default.
- W3013634249 hasConcept C117160843 @default.
- W3013634249 hasConcept C121332964 @default.
- W3013634249 hasConcept C126255220 @default.
- W3013634249 hasConcept C127413603 @default.
- W3013634249 hasConcept C134306372 @default.
- W3013634249 hasConcept C146978453 @default.
- W3013634249 hasConcept C147764199 @default.
- W3013634249 hasConcept C153258448 @default.
- W3013634249 hasConcept C154945302 @default.
- W3013634249 hasConcept C158622935 @default.
- W3013634249 hasConcept C162324750 @default.
- W3013634249 hasConcept C189237950 @default.
- W3013634249 hasConcept C2524010 @default.
- W3013634249 hasConcept C2776330181 @default.
- W3013634249 hasConcept C2776637919 @default.
- W3013634249 hasConcept C2777212361 @default.
- W3013634249 hasConcept C2777303404 @default.
- W3013634249 hasConcept C28826006 @default.
- W3013634249 hasConcept C33923547 @default.
- W3013634249 hasConcept C41008148 @default.
- W3013634249 hasConcept C50522688 @default.
- W3013634249 hasConcept C50644808 @default.
- W3013634249 hasConcept C62520636 @default.
- W3013634249 hasConceptScore W3013634249C112680207 @default.
- W3013634249 hasConceptScore W3013634249C114614502 @default.
- W3013634249 hasConceptScore W3013634249C116149140 @default.
- W3013634249 hasConceptScore W3013634249C117160843 @default.
- W3013634249 hasConceptScore W3013634249C121332964 @default.
- W3013634249 hasConceptScore W3013634249C126255220 @default.
- W3013634249 hasConceptScore W3013634249C127413603 @default.
- W3013634249 hasConceptScore W3013634249C134306372 @default.
- W3013634249 hasConceptScore W3013634249C146978453 @default.
- W3013634249 hasConceptScore W3013634249C147764199 @default.
- W3013634249 hasConceptScore W3013634249C153258448 @default.
- W3013634249 hasConceptScore W3013634249C154945302 @default.
- W3013634249 hasConceptScore W3013634249C158622935 @default.
- W3013634249 hasConceptScore W3013634249C162324750 @default.
- W3013634249 hasConceptScore W3013634249C189237950 @default.
- W3013634249 hasConceptScore W3013634249C2524010 @default.
- W3013634249 hasConceptScore W3013634249C2776330181 @default.
- W3013634249 hasConceptScore W3013634249C2776637919 @default.
- W3013634249 hasConceptScore W3013634249C2777212361 @default.
- W3013634249 hasConceptScore W3013634249C2777303404 @default.
- W3013634249 hasConceptScore W3013634249C28826006 @default.
- W3013634249 hasConceptScore W3013634249C33923547 @default.
- W3013634249 hasConceptScore W3013634249C41008148 @default.
- W3013634249 hasConceptScore W3013634249C50522688 @default.
- W3013634249 hasConceptScore W3013634249C50644808 @default.
- W3013634249 hasConceptScore W3013634249C62520636 @default.
- W3013634249 hasLocation W30136342491 @default.
- W3013634249 hasOpenAccess W3013634249 @default.
- W3013634249 hasPrimaryLocation W30136342491 @default.
- W3013634249 hasRelatedWork W2267705074 @default.
- W3013634249 hasRelatedWork W2407904812 @default.
- W3013634249 hasRelatedWork W2556623528 @default.
- W3013634249 hasRelatedWork W2762438520 @default.
- W3013634249 hasRelatedWork W2892002891 @default.