Matches in SemOpenAlex for { <https://semopenalex.org/work/W4320342238> ?p ?o ?g. }
Showing items 1 to 55 of
55
with 100 items per page.
- W4320342238 abstract "The minimax optimization over Riemannian manifolds (possibly nonconvex constraints) has been actively applied to solve many problems, such as robust dimensionality reduction and deep neural networks with orthogonal weights (Stiefel manifold). Although many optimization algorithms for minimax problems have been developed in the Euclidean setting, it is difficult to convert them into Riemannian cases, and algorithms for nonconvex minimax problems with nonconvex constraints are even rare. On the other hand, to address the big data challenges, decentralized (serverless) training techniques have recently been emerging since they can reduce communications overhead and avoid the bottleneck problem on the server node. Nonetheless, the algorithm for decentralized Riemannian minimax problems has not been studied. In this paper, we study the distributed nonconvex-strongly-concave minimax optimization problem over the Stiefel manifold and propose both deterministic and stochastic minimax methods. The Steifel manifold is a non-convex set. The global function is represented as the finite sum of local functions. For the deterministic setting, we propose DRGDA and prove that our deterministic method achieves a gradient complexity of $O( epsilon^{-2})$ under mild conditions. For the stochastic setting, we propose DRSGDA and prove that our stochastic method achieves a gradient complexity of $O(epsilon^{-4})$. The DRGDA and DRSGDA are the first algorithms for distributed minimax optimization with nonconvex constraints with exact convergence. Extensive experimental results on the Deep Neural Networks (DNNs) training over the Stiefel manifold demonstrate the efficiency of our algorithms." @default.
- W4320342238 created "2023-02-13" @default.
- W4320342238 creator A5026601713 @default.
- W4320342238 creator A5053734709 @default.
- W4320342238 creator A5060016795 @default.
- W4320342238 date "2023-02-07" @default.
- W4320342238 modified "2023-10-14" @default.
- W4320342238 title "Decentralized Riemannian Algorithm for Nonconvex Minimax Problems" @default.
- W4320342238 doi "https://doi.org/10.48550/arxiv.2302.03825" @default.
- W4320342238 hasPublicationYear "2023" @default.
- W4320342238 type Work @default.
- W4320342238 citedByCount "0" @default.
- W4320342238 crossrefType "posted-content" @default.
- W4320342238 hasAuthorship W4320342238A5026601713 @default.
- W4320342238 hasAuthorship W4320342238A5053734709 @default.
- W4320342238 hasAuthorship W4320342238A5060016795 @default.
- W4320342238 hasBestOaLocation W43203422381 @default.
- W4320342238 hasConcept C102634674 @default.
- W4320342238 hasConcept C11413529 @default.
- W4320342238 hasConcept C126255220 @default.
- W4320342238 hasConcept C134306372 @default.
- W4320342238 hasConcept C137836250 @default.
- W4320342238 hasConcept C149728462 @default.
- W4320342238 hasConcept C2524010 @default.
- W4320342238 hasConcept C2779593128 @default.
- W4320342238 hasConcept C33923547 @default.
- W4320342238 hasConcept C41008148 @default.
- W4320342238 hasConcept C612670 @default.
- W4320342238 hasConceptScore W4320342238C102634674 @default.
- W4320342238 hasConceptScore W4320342238C11413529 @default.
- W4320342238 hasConceptScore W4320342238C126255220 @default.
- W4320342238 hasConceptScore W4320342238C134306372 @default.
- W4320342238 hasConceptScore W4320342238C137836250 @default.
- W4320342238 hasConceptScore W4320342238C149728462 @default.
- W4320342238 hasConceptScore W4320342238C2524010 @default.
- W4320342238 hasConceptScore W4320342238C2779593128 @default.
- W4320342238 hasConceptScore W4320342238C33923547 @default.
- W4320342238 hasConceptScore W4320342238C41008148 @default.
- W4320342238 hasConceptScore W4320342238C612670 @default.
- W4320342238 hasLocation W43203422381 @default.
- W4320342238 hasOpenAccess W4320342238 @default.
- W4320342238 hasPrimaryLocation W43203422381 @default.
- W4320342238 hasRelatedWork W2090440768 @default.
- W4320342238 hasRelatedWork W2166425104 @default.
- W4320342238 hasRelatedWork W2273126489 @default.
- W4320342238 hasRelatedWork W2322401527 @default.
- W4320342238 hasRelatedWork W3020483468 @default.
- W4320342238 hasRelatedWork W3038546127 @default.
- W4320342238 hasRelatedWork W3149052698 @default.
- W4320342238 hasRelatedWork W3182145356 @default.
- W4320342238 hasRelatedWork W4320342238 @default.
- W4320342238 hasRelatedWork W48205870 @default.
- W4320342238 isParatext "false" @default.
- W4320342238 isRetracted "false" @default.
- W4320342238 workType "article" @default.