Matches in SemOpenAlex for { <https://semopenalex.org/work/W4288099609> ?p ?o ?g. }
Showing items 1 to 80 of
80
with 100 items per page.
- W4288099609 abstract "While directly fine-tuning (FT) large-scale, pretrained models on task-specific data is well-known to induce strong in-distribution task performance, recent works have demonstrated that different adaptation protocols, such as linear probing (LP) prior to FT, can improve out-of-distribution generalization. However, the design space of such adaptation protocols remains under-explored and the evaluation of such protocols has primarily focused on distribution shifts. Therefore, in this work, we evaluate common adaptation protocols across distributions shifts and machine learning safety metrics (e.g., anomaly detection, calibration, robustness to corruptions). We find that protocols induce disparate trade-offs that were not apparent from prior evaluation. Further, we demonstrate that appropriate pairing of data augmentation and protocol can substantially mitigate this trade-off. Finally, we hypothesize and empirically see that using hardness-promoting augmentations during LP and then FT with augmentations may be particularly effective for trade-off mitigation." @default.
- W4288099609 created "2022-07-28" @default.
- W4288099609 creator A5015996266 @default.
- W4288099609 creator A5042391338 @default.
- W4288099609 creator A5046632395 @default.
- W4288099609 date "2022-07-25" @default.
- W4288099609 modified "2023-09-23" @default.
- W4288099609 title "Exploring the Design of Adaptation Protocols for Improved Generalization and Machine Learning Safety" @default.
- W4288099609 doi "https://doi.org/10.48550/arxiv.2207.12615" @default.
- W4288099609 hasPublicationYear "2022" @default.
- W4288099609 type Work @default.
- W4288099609 citedByCount "0" @default.
- W4288099609 crossrefType "posted-content" @default.
- W4288099609 hasAuthorship W4288099609A5015996266 @default.
- W4288099609 hasAuthorship W4288099609A5042391338 @default.
- W4288099609 hasAuthorship W4288099609A5046632395 @default.
- W4288099609 hasBestOaLocation W42880996091 @default.
- W4288099609 hasConcept C104317684 @default.
- W4288099609 hasConcept C119857082 @default.
- W4288099609 hasConcept C120665830 @default.
- W4288099609 hasConcept C121332964 @default.
- W4288099609 hasConcept C127413603 @default.
- W4288099609 hasConcept C134306372 @default.
- W4288099609 hasConcept C139807058 @default.
- W4288099609 hasConcept C14103023 @default.
- W4288099609 hasConcept C142724271 @default.
- W4288099609 hasConcept C154945302 @default.
- W4288099609 hasConcept C177148314 @default.
- W4288099609 hasConcept C185592680 @default.
- W4288099609 hasConcept C201995342 @default.
- W4288099609 hasConcept C204787440 @default.
- W4288099609 hasConcept C2780385302 @default.
- W4288099609 hasConcept C2780451532 @default.
- W4288099609 hasConcept C33923547 @default.
- W4288099609 hasConcept C41008148 @default.
- W4288099609 hasConcept C54101563 @default.
- W4288099609 hasConcept C55493867 @default.
- W4288099609 hasConcept C62520636 @default.
- W4288099609 hasConcept C63479239 @default.
- W4288099609 hasConcept C71924100 @default.
- W4288099609 hasConceptScore W4288099609C104317684 @default.
- W4288099609 hasConceptScore W4288099609C119857082 @default.
- W4288099609 hasConceptScore W4288099609C120665830 @default.
- W4288099609 hasConceptScore W4288099609C121332964 @default.
- W4288099609 hasConceptScore W4288099609C127413603 @default.
- W4288099609 hasConceptScore W4288099609C134306372 @default.
- W4288099609 hasConceptScore W4288099609C139807058 @default.
- W4288099609 hasConceptScore W4288099609C14103023 @default.
- W4288099609 hasConceptScore W4288099609C142724271 @default.
- W4288099609 hasConceptScore W4288099609C154945302 @default.
- W4288099609 hasConceptScore W4288099609C177148314 @default.
- W4288099609 hasConceptScore W4288099609C185592680 @default.
- W4288099609 hasConceptScore W4288099609C201995342 @default.
- W4288099609 hasConceptScore W4288099609C204787440 @default.
- W4288099609 hasConceptScore W4288099609C2780385302 @default.
- W4288099609 hasConceptScore W4288099609C2780451532 @default.
- W4288099609 hasConceptScore W4288099609C33923547 @default.
- W4288099609 hasConceptScore W4288099609C41008148 @default.
- W4288099609 hasConceptScore W4288099609C54101563 @default.
- W4288099609 hasConceptScore W4288099609C55493867 @default.
- W4288099609 hasConceptScore W4288099609C62520636 @default.
- W4288099609 hasConceptScore W4288099609C63479239 @default.
- W4288099609 hasConceptScore W4288099609C71924100 @default.
- W4288099609 hasLocation W42880996091 @default.
- W4288099609 hasLocation W42880996092 @default.
- W4288099609 hasOpenAccess W4288099609 @default.
- W4288099609 hasPrimaryLocation W42880996091 @default.
- W4288099609 hasRelatedWork W10050540 @default.
- W4288099609 hasRelatedWork W10944326 @default.
- W4288099609 hasRelatedWork W11023528 @default.
- W4288099609 hasRelatedWork W14777649 @default.
- W4288099609 hasRelatedWork W14789944 @default.
- W4288099609 hasRelatedWork W2000177 @default.
- W4288099609 hasRelatedWork W3569651 @default.
- W4288099609 hasRelatedWork W6229082 @default.
- W4288099609 hasRelatedWork W6503359 @default.
- W4288099609 hasRelatedWork W6996585 @default.
- W4288099609 isParatext "false" @default.
- W4288099609 isRetracted "false" @default.
- W4288099609 workType "article" @default.