Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387294219> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W4387294219 abstract "Nowadays, understanding the geometry of the loss landscape shows promise in enhancing a model's generalization ability. In this work, we draw upon prior works that apply geometric principles to optimization and present a novel approach to improve robustness and generalization ability for constrained optimization problems. Indeed, this paper aims to generalize the Sharpness-Aware Minimization (SAM) optimizer to Riemannian manifolds. In doing so, we first extend the concept of sharpness and introduce a novel notion of sharpness on manifolds. To support this notion of sharpness, we present a theoretical analysis characterizing generalization capabilities with respect to manifold sharpness, which demonstrates a tighter bound on the generalization gap, a result not known before. Motivated by this analysis, we introduce our algorithm, Riemannian Sharpness-Aware Minimization (RSAM). To demonstrate RSAM's ability to enhance generalization ability, we evaluate and contrast our algorithm on a broad set of problems, such as image classification and contrastive learning across different datasets, including CIFAR100, CIFAR10, and FGVCAircraft. Our code is publicly available at url{https://t.ly/RiemannianSAM}." @default.
- W4387294219 created "2023-10-03" @default.
- W4387294219 creator A5010129716 @default.
- W4387294219 creator A5021790939 @default.
- W4387294219 creator A5036447132 @default.
- W4387294219 creator A5041968718 @default.
- W4387294219 creator A5046694753 @default.
- W4387294219 creator A5069642121 @default.
- W4387294219 creator A5083741977 @default.
- W4387294219 date "2023-09-29" @default.
- W4387294219 modified "2023-10-04" @default.
- W4387294219 title "RSAM: Learning on manifolds with Riemannian Sharpness-aware Minimization" @default.
- W4387294219 doi "https://doi.org/10.48550/arxiv.2309.17215" @default.
- W4387294219 hasPublicationYear "2023" @default.
- W4387294219 type Work @default.
- W4387294219 citedByCount "0" @default.
- W4387294219 crossrefType "posted-content" @default.
- W4387294219 hasAuthorship W4387294219A5010129716 @default.
- W4387294219 hasAuthorship W4387294219A5021790939 @default.
- W4387294219 hasAuthorship W4387294219A5036447132 @default.
- W4387294219 hasAuthorship W4387294219A5041968718 @default.
- W4387294219 hasAuthorship W4387294219A5046694753 @default.
- W4387294219 hasAuthorship W4387294219A5069642121 @default.
- W4387294219 hasAuthorship W4387294219A5083741977 @default.
- W4387294219 hasBestOaLocation W43872942191 @default.
- W4387294219 hasConcept C104317684 @default.
- W4387294219 hasConcept C11413529 @default.
- W4387294219 hasConcept C126255220 @default.
- W4387294219 hasConcept C127413603 @default.
- W4387294219 hasConcept C134306372 @default.
- W4387294219 hasConcept C147764199 @default.
- W4387294219 hasConcept C154945302 @default.
- W4387294219 hasConcept C177148314 @default.
- W4387294219 hasConcept C177264268 @default.
- W4387294219 hasConcept C181104567 @default.
- W4387294219 hasConcept C185592680 @default.
- W4387294219 hasConcept C199360897 @default.
- W4387294219 hasConcept C202444582 @default.
- W4387294219 hasConcept C2776760102 @default.
- W4387294219 hasConcept C2779593128 @default.
- W4387294219 hasConcept C33923547 @default.
- W4387294219 hasConcept C41008148 @default.
- W4387294219 hasConcept C529865628 @default.
- W4387294219 hasConcept C55493867 @default.
- W4387294219 hasConcept C63479239 @default.
- W4387294219 hasConcept C78519656 @default.
- W4387294219 hasConceptScore W4387294219C104317684 @default.
- W4387294219 hasConceptScore W4387294219C11413529 @default.
- W4387294219 hasConceptScore W4387294219C126255220 @default.
- W4387294219 hasConceptScore W4387294219C127413603 @default.
- W4387294219 hasConceptScore W4387294219C134306372 @default.
- W4387294219 hasConceptScore W4387294219C147764199 @default.
- W4387294219 hasConceptScore W4387294219C154945302 @default.
- W4387294219 hasConceptScore W4387294219C177148314 @default.
- W4387294219 hasConceptScore W4387294219C177264268 @default.
- W4387294219 hasConceptScore W4387294219C181104567 @default.
- W4387294219 hasConceptScore W4387294219C185592680 @default.
- W4387294219 hasConceptScore W4387294219C199360897 @default.
- W4387294219 hasConceptScore W4387294219C202444582 @default.
- W4387294219 hasConceptScore W4387294219C2776760102 @default.
- W4387294219 hasConceptScore W4387294219C2779593128 @default.
- W4387294219 hasConceptScore W4387294219C33923547 @default.
- W4387294219 hasConceptScore W4387294219C41008148 @default.
- W4387294219 hasConceptScore W4387294219C529865628 @default.
- W4387294219 hasConceptScore W4387294219C55493867 @default.
- W4387294219 hasConceptScore W4387294219C63479239 @default.
- W4387294219 hasConceptScore W4387294219C78519656 @default.
- W4387294219 hasLocation W43872942191 @default.
- W4387294219 hasOpenAccess W4387294219 @default.
- W4387294219 hasPrimaryLocation W43872942191 @default.
- W4387294219 hasRelatedWork W1975282624 @default.
- W4387294219 hasRelatedWork W2157502374 @default.
- W4387294219 hasRelatedWork W2164995684 @default.
- W4387294219 hasRelatedWork W2349869535 @default.
- W4387294219 hasRelatedWork W2389851267 @default.
- W4387294219 hasRelatedWork W2546668543 @default.
- W4387294219 hasRelatedWork W2557596507 @default.
- W4387294219 hasRelatedWork W2738323209 @default.
- W4387294219 hasRelatedWork W2999284236 @default.
- W4387294219 hasRelatedWork W3128032095 @default.
- W4387294219 isParatext "false" @default.
- W4387294219 isRetracted "false" @default.
- W4387294219 workType "article" @default.