Matches in SemOpenAlex for { <https://semopenalex.org/work/W3213779919> ?p ?o ?g. }
- W3213779919 abstract "Adversarial training (AT) has become a popular choice for training robust networks. However, it tends to sacrifice clean accuracy heavily in favor of robustness and suffers from a large generalization error. To address these concerns, we propose Smooth Adversarial Training (SAT), guided by our analysis on the eigenspectrum of the loss Hessian. We find that curriculum learning, a scheme that emphasizes on starting easy and gradually ramping up on the of training, smooths the adversarial loss landscape for a suitably chosen difficulty metric. We present a general formulation for curriculum learning in the adversarial setting and propose two difficulty metrics based on the maximal Hessian eigenvalue (H-SAT) and the softmax probability (P-SA). We demonstrate that SAT stabilizes network training even for a large perturbation norm and allows the network to operate at a better clean accuracy versus robustness trade-off curve compared to AT. This leads to a significant improvement in both clean accuracy and robustness compared to AT, TRADES, and other baselines. To highlight a few results, our best model improves normal and robust accuracy by 6% and 1% on CIFAR-100 compared to AT, respectively. On Imagenette, a ten-class subset of ImageNet, our model outperforms AT by 23% and 3% on normal and robust accuracy respectively." @default.
- W3213779919 created "2021-11-22" @default.
- W3213779919 creator A5018968047 @default.
- W3213779919 creator A5040461332 @default.
- W3213779919 creator A5062174672 @default.
- W3213779919 date "2021-11-08" @default.
- W3213779919 modified "2023-09-23" @default.
- W3213779919 title "SAT: Improving Adversarial Training via Curriculum-Based Loss Smoothing." @default.
- W3213779919 cites W2093488901 @default.
- W3213779919 cites W2142426721 @default.
- W3213779919 cites W2296073425 @default.
- W3213779919 cites W2474090883 @default.
- W3213779919 cites W2912811302 @default.
- W3213779919 cites W2945793108 @default.
- W3213779919 cites W2962729158 @default.
- W3213779919 cites W2962933129 @default.
- W3213779919 cites W2963143631 @default.
- W3213779919 cites W2963173418 @default.
- W3213779919 cites W2963207607 @default.
- W3213779919 cites W2963636205 @default.
- W3213779919 cites W2963959597 @default.
- W3213779919 cites W2963983495 @default.
- W3213779919 cites W2964122237 @default.
- W3213779919 cites W2964153729 @default.
- W3213779919 cites W2964253222 @default.
- W3213779919 cites W2970317235 @default.
- W3213779919 cites W2982733768 @default.
- W3213779919 cites W2995245581 @default.
- W3213779919 cites W2996344901 @default.
- W3213779919 cites W2996564870 @default.
- W3213779919 cites W3034385750 @default.
- W3213779919 cites W3034994123 @default.
- W3213779919 cites W3035032188 @default.
- W3213779919 cites W3093329015 @default.
- W3213779919 cites W3103385169 @default.
- W3213779919 cites W3103640475 @default.
- W3213779919 cites W9657784 @default.
- W3213779919 hasPublicationYear "2021" @default.
- W3213779919 type Work @default.
- W3213779919 sameAs 3213779919 @default.
- W3213779919 citedByCount "0" @default.
- W3213779919 crossrefType "posted-content" @default.
- W3213779919 hasAuthorship W3213779919A5018968047 @default.
- W3213779919 hasAuthorship W3213779919A5040461332 @default.
- W3213779919 hasAuthorship W3213779919A5062174672 @default.
- W3213779919 hasConcept C104317684 @default.
- W3213779919 hasConcept C119857082 @default.
- W3213779919 hasConcept C126255220 @default.
- W3213779919 hasConcept C149728462 @default.
- W3213779919 hasConcept C154945302 @default.
- W3213779919 hasConcept C185592680 @default.
- W3213779919 hasConcept C203616005 @default.
- W3213779919 hasConcept C28826006 @default.
- W3213779919 hasConcept C2984842247 @default.
- W3213779919 hasConcept C33923547 @default.
- W3213779919 hasConcept C37736160 @default.
- W3213779919 hasConcept C41008148 @default.
- W3213779919 hasConcept C50644808 @default.
- W3213779919 hasConcept C55493867 @default.
- W3213779919 hasConcept C63479239 @default.
- W3213779919 hasConceptScore W3213779919C104317684 @default.
- W3213779919 hasConceptScore W3213779919C119857082 @default.
- W3213779919 hasConceptScore W3213779919C126255220 @default.
- W3213779919 hasConceptScore W3213779919C149728462 @default.
- W3213779919 hasConceptScore W3213779919C154945302 @default.
- W3213779919 hasConceptScore W3213779919C185592680 @default.
- W3213779919 hasConceptScore W3213779919C203616005 @default.
- W3213779919 hasConceptScore W3213779919C28826006 @default.
- W3213779919 hasConceptScore W3213779919C2984842247 @default.
- W3213779919 hasConceptScore W3213779919C33923547 @default.
- W3213779919 hasConceptScore W3213779919C37736160 @default.
- W3213779919 hasConceptScore W3213779919C41008148 @default.
- W3213779919 hasConceptScore W3213779919C50644808 @default.
- W3213779919 hasConceptScore W3213779919C55493867 @default.
- W3213779919 hasConceptScore W3213779919C63479239 @default.
- W3213779919 hasLocation W32137799191 @default.
- W3213779919 hasOpenAccess W3213779919 @default.
- W3213779919 hasPrimaryLocation W32137799191 @default.
- W3213779919 hasRelatedWork W2896753426 @default.
- W3213779919 hasRelatedWork W2945724059 @default.
- W3213779919 hasRelatedWork W2951341641 @default.
- W3213779919 hasRelatedWork W2954744211 @default.
- W3213779919 hasRelatedWork W2980728855 @default.
- W3213779919 hasRelatedWork W2996690718 @default.
- W3213779919 hasRelatedWork W3013721920 @default.
- W3213779919 hasRelatedWork W3034537217 @default.
- W3213779919 hasRelatedWork W3098560605 @default.
- W3213779919 hasRelatedWork W3105518162 @default.
- W3213779919 hasRelatedWork W3116831402 @default.
- W3213779919 hasRelatedWork W3132501505 @default.
- W3213779919 hasRelatedWork W3134621603 @default.
- W3213779919 hasRelatedWork W3136095779 @default.
- W3213779919 hasRelatedWork W3153582542 @default.
- W3213779919 hasRelatedWork W3156389890 @default.
- W3213779919 hasRelatedWork W3196588968 @default.
- W3213779919 hasRelatedWork W3210283826 @default.
- W3213779919 hasRelatedWork W3211892047 @default.
- W3213779919 hasRelatedWork W3158637424 @default.
- W3213779919 isParatext "false" @default.
- W3213779919 isRetracted "false" @default.