Matches in SemOpenAlex for { <https://semopenalex.org/work/W3036176146> ?p ?o ?g. }
- W3036176146 abstract "Meta-learning methods have shown an impressive ability to train models that rapidly learn new tasks. However, these methods only aim to perform well in expectation over tasks coming from some particular distribution that is typically equivalent across meta-training and meta-testing, rather than considering worst-case task performance. In this work we introduce the notion of task-robustness by reformulating the popular Model-Agnostic Meta-Learning (MAML) objective [Finn et al. 2017] such that the goal is to minimize the maximum loss over the observed meta-training tasks. The solution to this novel formulation is task-robust in the sense that it places equal importance on even the most difficult and/or rare tasks. This also means that it performs well over all distributions of the observed tasks, making it robust to shifts in the task distribution between meta-training and meta-testing. We present an algorithm to solve the proposed min-max problem, and show that it converges to an $epsilon$-accurate point at the optimal rate of $mathcal{O}(1/epsilon^2)$ in the convex setting and to an $(epsilon, delta)$-stationary point at the rate of $mathcal{O}(max{1/epsilon^5, 1/delta^5})$ in nonconvex settings. We also provide an upper bound on the new task generalization error that captures the advantage of minimizing the worst-case task loss, and demonstrate this advantage in sinusoid regression and image classification experiments." @default.
- W3036176146 created "2020-06-25" @default.
- W3036176146 creator A5008417632 @default.
- W3036176146 creator A5028903768 @default.
- W3036176146 creator A5047023011 @default.
- W3036176146 date "2020-02-12" @default.
- W3036176146 modified "2023-09-23" @default.
- W3036176146 title "Task-Robust Model-Agnostic Meta-Learning" @default.
- W3036176146 cites W1621791442 @default.
- W3036176146 cites W1856231595 @default.
- W3036176146 cites W1944672 @default.
- W3036176146 cites W1992208280 @default.
- W3036176146 cites W2029463628 @default.
- W3036176146 cites W2194321275 @default.
- W3036176146 cites W2295869408 @default.
- W3036176146 cites W2531499355 @default.
- W3036176146 cites W2550182557 @default.
- W3036176146 cites W2601450892 @default.
- W3036176146 cites W2604763608 @default.
- W3036176146 cites W2742093937 @default.
- W3036176146 cites W2753160622 @default.
- W3036176146 cites W2794363191 @default.
- W3036176146 cites W2806143712 @default.
- W3036176146 cites W2895628298 @default.
- W3036176146 cites W2896534181 @default.
- W3036176146 cites W2911319680 @default.
- W3036176146 cites W2914953695 @default.
- W3036176146 cites W2925446857 @default.
- W3036176146 cites W2926246612 @default.
- W3036176146 cites W2962688627 @default.
- W3036176146 cites W2962730916 @default.
- W3036176146 cites W2962799101 @default.
- W3036176146 cites W2963049063 @default.
- W3036176146 cites W2963070905 @default.
- W3036176146 cites W2963303956 @default.
- W3036176146 cites W2963341924 @default.
- W3036176146 cites W2964121860 @default.
- W3036176146 cites W2964206659 @default.
- W3036176146 cites W2970389519 @default.
- W3036176146 cites W2970416783 @default.
- W3036176146 cites W2970697704 @default.
- W3036176146 cites W2970814018 @default.
- W3036176146 cites W2978843034 @default.
- W3036176146 cites W2982094913 @default.
- W3036176146 cites W2995808739 @default.
- W3036176146 cites W3012725491 @default.
- W3036176146 cites W3037724881 @default.
- W3036176146 cites W99485931 @default.
- W3036176146 hasPublicationYear "2020" @default.
- W3036176146 type Work @default.
- W3036176146 sameAs 3036176146 @default.
- W3036176146 citedByCount "2" @default.
- W3036176146 countsByYear W30361761462021 @default.
- W3036176146 crossrefType "posted-content" @default.
- W3036176146 hasAuthorship W3036176146A5008417632 @default.
- W3036176146 hasAuthorship W3036176146A5028903768 @default.
- W3036176146 hasAuthorship W3036176146A5047023011 @default.
- W3036176146 hasConcept C104317684 @default.
- W3036176146 hasConcept C112680207 @default.
- W3036176146 hasConcept C11413529 @default.
- W3036176146 hasConcept C117765406 @default.
- W3036176146 hasConcept C119857082 @default.
- W3036176146 hasConcept C134306372 @default.
- W3036176146 hasConcept C154945302 @default.
- W3036176146 hasConcept C162324750 @default.
- W3036176146 hasConcept C177148314 @default.
- W3036176146 hasConcept C185592680 @default.
- W3036176146 hasConcept C187736073 @default.
- W3036176146 hasConcept C2524010 @default.
- W3036176146 hasConcept C2780451532 @default.
- W3036176146 hasConcept C28006648 @default.
- W3036176146 hasConcept C33923547 @default.
- W3036176146 hasConcept C40969351 @default.
- W3036176146 hasConcept C41008148 @default.
- W3036176146 hasConcept C50644808 @default.
- W3036176146 hasConcept C55493867 @default.
- W3036176146 hasConcept C63479239 @default.
- W3036176146 hasConceptScore W3036176146C104317684 @default.
- W3036176146 hasConceptScore W3036176146C112680207 @default.
- W3036176146 hasConceptScore W3036176146C11413529 @default.
- W3036176146 hasConceptScore W3036176146C117765406 @default.
- W3036176146 hasConceptScore W3036176146C119857082 @default.
- W3036176146 hasConceptScore W3036176146C134306372 @default.
- W3036176146 hasConceptScore W3036176146C154945302 @default.
- W3036176146 hasConceptScore W3036176146C162324750 @default.
- W3036176146 hasConceptScore W3036176146C177148314 @default.
- W3036176146 hasConceptScore W3036176146C185592680 @default.
- W3036176146 hasConceptScore W3036176146C187736073 @default.
- W3036176146 hasConceptScore W3036176146C2524010 @default.
- W3036176146 hasConceptScore W3036176146C2780451532 @default.
- W3036176146 hasConceptScore W3036176146C28006648 @default.
- W3036176146 hasConceptScore W3036176146C33923547 @default.
- W3036176146 hasConceptScore W3036176146C40969351 @default.
- W3036176146 hasConceptScore W3036176146C41008148 @default.
- W3036176146 hasConceptScore W3036176146C50644808 @default.
- W3036176146 hasConceptScore W3036176146C55493867 @default.
- W3036176146 hasConceptScore W3036176146C63479239 @default.
- W3036176146 hasLocation W30361761461 @default.
- W3036176146 hasOpenAccess W3036176146 @default.
- W3036176146 hasPrimaryLocation W30361761461 @default.