Matches in SemOpenAlex for { <https://semopenalex.org/work/W3172820969> ?p ?o ?g. }
- W3172820969 abstract "Domain generalization (DG) methods aim to achieve generalizability to an unseen target domain by using only training data from the source domains. Although a variety of DG methods have been proposed, a recent study shows that under a fair evaluation protocol, called DomainBed, the simple empirical risk minimization (ERM) approach works comparable to or even outperforms previous methods. Unfortunately, simply solving ERM on a complex, non-convex loss function can easily lead to sub-optimal generalizability by seeking sharp minima. In this paper, we theoretically show that finding flat minima results in a smaller domain generalization gap. We also propose a simple yet effective method, named Stochastic Weight Averaging Densely (SWAD), to find flat minima. SWAD finds flatter minima and suffers less from overfitting than does the vanilla SWA by a dense and overfit-aware stochastic weight sampling strategy. SWAD shows state-of-the-art performances on five DG benchmarks, namely PACS, VLCS, OfficeHome, TerraIncognita, and DomainNet, with consistent and large margins of +1.6% averagely on out-of-domain accuracy. We also compare SWAD with conventional generalization methods, such as data augmentation and consistency regularization methods, to verify that the remarkable performance improvements are originated from by seeking flat minima, not from better in-domain generalizability. Last but not least, SWAD is readily adaptable to existing DG methods without modification; the combination of SWAD and an existing DG method further improves DG performances. Source code is available at https://github.com/khanrc/swad." @default.
- W3172820969 created "2021-06-22" @default.
- W3172820969 creator A5002722298 @default.
- W3172820969 creator A5028729111 @default.
- W3172820969 creator A5048067770 @default.
- W3172820969 creator A5053327616 @default.
- W3172820969 creator A5063999144 @default.
- W3172820969 creator A5067167236 @default.
- W3172820969 creator A5074098034 @default.
- W3172820969 date "2021-02-17" @default.
- W3172820969 modified "2023-09-27" @default.
- W3172820969 title "SWAD: Domain Generalization by Seeking Flat Minima" @default.
- W3172820969 cites W1731081199 @default.
- W3172820969 cites W2086161653 @default.
- W3172820969 cites W2104094955 @default.
- W3172820969 cites W2117539524 @default.
- W3172820969 cites W2148603752 @default.
- W3172820969 cites W2155858138 @default.
- W3172820969 cites W2167366427 @default.
- W3172820969 cites W2194775991 @default.
- W3172820969 cites W2552194003 @default.
- W3172820969 cites W2622263826 @default.
- W3172820969 cites W2627183927 @default.
- W3172820969 cites W2763549966 @default.
- W3172820969 cites W2798658180 @default.
- W3172820969 cites W2883386984 @default.
- W3172820969 cites W2889965839 @default.
- W3172820969 cites W2895777173 @default.
- W3172820969 cites W2895976713 @default.
- W3172820969 cites W2902617128 @default.
- W3172820969 cites W2953494151 @default.
- W3172820969 cites W2958360136 @default.
- W3172820969 cites W2961540362 @default.
- W3172820969 cites W2963060032 @default.
- W3172820969 cites W2963173418 @default.
- W3172820969 cites W2963384892 @default.
- W3172820969 cites W2963399829 @default.
- W3172820969 cites W2963509076 @default.
- W3172820969 cites W2963838962 @default.
- W3172820969 cites W2963959597 @default.
- W3172820969 cites W2964054038 @default.
- W3172820969 cites W2964121744 @default.
- W3172820969 cites W2964124968 @default.
- W3172820969 cites W2964159205 @default.
- W3172820969 cites W2964288524 @default.
- W3172820969 cites W2969489725 @default.
- W3172820969 cites W2970119729 @default.
- W3172820969 cites W2981720610 @default.
- W3172820969 cites W2981788812 @default.
- W3172820969 cites W2992043355 @default.
- W3172820969 cites W2992308087 @default.
- W3172820969 cites W2995793065 @default.
- W3172820969 cites W2996823446 @default.
- W3172820969 cites W2997310315 @default.
- W3172820969 cites W3007592798 @default.
- W3172820969 cites W3016179654 @default.
- W3172820969 cites W3035037113 @default.
- W3172820969 cites W3037492894 @default.
- W3172820969 cites W3038745855 @default.
- W3172820969 cites W3101298150 @default.
- W3172820969 cites W3103937687 @default.
- W3172820969 cites W3109635165 @default.
- W3172820969 cites W3109831211 @default.
- W3172820969 cites W3109986233 @default.
- W3172820969 cites W3121432811 @default.
- W3172820969 cites W3122542623 @default.
- W3172820969 cites W3124626396 @default.
- W3172820969 cites W3128018413 @default.
- W3172820969 cites W3128637142 @default.
- W3172820969 cites W3175215201 @default.
- W3172820969 cites W3177450132 @default.
- W3172820969 hasPublicationYear "2021" @default.
- W3172820969 type Work @default.
- W3172820969 sameAs 3172820969 @default.
- W3172820969 citedByCount "0" @default.
- W3172820969 crossrefType "posted-content" @default.
- W3172820969 hasAuthorship W3172820969A5002722298 @default.
- W3172820969 hasAuthorship W3172820969A5028729111 @default.
- W3172820969 hasAuthorship W3172820969A5048067770 @default.
- W3172820969 hasAuthorship W3172820969A5053327616 @default.
- W3172820969 hasAuthorship W3172820969A5063999144 @default.
- W3172820969 hasAuthorship W3172820969A5067167236 @default.
- W3172820969 hasAuthorship W3172820969A5074098034 @default.
- W3172820969 hasBestOaLocation W31728209691 @default.
- W3172820969 hasConcept C105795698 @default.
- W3172820969 hasConcept C11413529 @default.
- W3172820969 hasConcept C126255220 @default.
- W3172820969 hasConcept C134306372 @default.
- W3172820969 hasConcept C154945302 @default.
- W3172820969 hasConcept C177148314 @default.
- W3172820969 hasConcept C186633575 @default.
- W3172820969 hasConcept C22019652 @default.
- W3172820969 hasConcept C27158222 @default.
- W3172820969 hasConcept C2776436953 @default.
- W3172820969 hasConcept C33923547 @default.
- W3172820969 hasConcept C36503486 @default.
- W3172820969 hasConcept C41008148 @default.
- W3172820969 hasConcept C50644808 @default.
- W3172820969 hasConceptScore W3172820969C105795698 @default.
- W3172820969 hasConceptScore W3172820969C11413529 @default.