Matches in SemOpenAlex for { <https://semopenalex.org/work/W3100702524> ?p ?o ?g. }
Showing items 1 to 92 of
92
with 100 items per page.
- W3100702524 endingPage "11500" @default.
- W3100702524 startingPage "11490" @default.
- W3100702524 abstract "Although model-agnostic meta-learning (MAML) is a very successful algorithm in meta-learning practice, it can have high computational cost because it updates all model parameters over both the inner loop of task-specific adaptation and the outer-loop of meta initialization training. A more efficient algorithm ANIL (which refers to almost no inner loop) was proposed recently by Raghu et al. 2019, which adapts only a small subset of parameters in the inner loop and thus has substantially less computational cost than MAML as demonstrated by extensive experiments. However, the theoretical convergence of ANIL has not been studied yet. In this paper, we characterize the convergence rate and the computational complexity for ANIL under two representative inner-loop loss geometries, i.e., strongly-convexity and nonconvexity. Our results show that such a geometric property can significantly affect the overall convergence performance of ANIL. For example, ANIL achieves a faster convergence rate for a strongly-convex inner-loop loss as the number $N$ of inner-loop gradient descent steps increases, but a slower convergence rate for a nonconvex inner-loop loss as $N$ increases. Moreover, our complexity analysis provides a theoretical quantification on the improved efficiency of ANIL over MAML. The experiments on standard few-shot meta-learning benchmarks validate our theoretical findings." @default.
- W3100702524 created "2020-11-23" @default.
- W3100702524 creator A5002586054 @default.
- W3100702524 creator A5042048777 @default.
- W3100702524 creator A5042307561 @default.
- W3100702524 creator A5071973105 @default.
- W3100702524 date "2020-06-16" @default.
- W3100702524 modified "2023-09-29" @default.
- W3100702524 title "Convergence of meta-learning with task-specific adaptation over partial parameters" @default.
- W3100702524 hasPublicationYear "2020" @default.
- W3100702524 type Work @default.
- W3100702524 sameAs 3100702524 @default.
- W3100702524 citedByCount "2" @default.
- W3100702524 countsByYear W31007025242020 @default.
- W3100702524 countsByYear W31007025242021 @default.
- W3100702524 crossrefType "proceedings-article" @default.
- W3100702524 hasAuthorship W3100702524A5002586054 @default.
- W3100702524 hasAuthorship W3100702524A5042048777 @default.
- W3100702524 hasAuthorship W3100702524A5042307561 @default.
- W3100702524 hasAuthorship W3100702524A5071973105 @default.
- W3100702524 hasConcept C106159729 @default.
- W3100702524 hasConcept C11413529 @default.
- W3100702524 hasConcept C114466953 @default.
- W3100702524 hasConcept C114614502 @default.
- W3100702524 hasConcept C126255220 @default.
- W3100702524 hasConcept C127162648 @default.
- W3100702524 hasConcept C162324750 @default.
- W3100702524 hasConcept C179799912 @default.
- W3100702524 hasConcept C184670325 @default.
- W3100702524 hasConcept C199360897 @default.
- W3100702524 hasConcept C203479927 @default.
- W3100702524 hasConcept C2777303404 @default.
- W3100702524 hasConcept C31258907 @default.
- W3100702524 hasConcept C33923547 @default.
- W3100702524 hasConcept C41008148 @default.
- W3100702524 hasConcept C50522688 @default.
- W3100702524 hasConcept C57869625 @default.
- W3100702524 hasConcept C58716799 @default.
- W3100702524 hasConcept C6557445 @default.
- W3100702524 hasConcept C72134830 @default.
- W3100702524 hasConcept C86803240 @default.
- W3100702524 hasConceptScore W3100702524C106159729 @default.
- W3100702524 hasConceptScore W3100702524C11413529 @default.
- W3100702524 hasConceptScore W3100702524C114466953 @default.
- W3100702524 hasConceptScore W3100702524C114614502 @default.
- W3100702524 hasConceptScore W3100702524C126255220 @default.
- W3100702524 hasConceptScore W3100702524C127162648 @default.
- W3100702524 hasConceptScore W3100702524C162324750 @default.
- W3100702524 hasConceptScore W3100702524C179799912 @default.
- W3100702524 hasConceptScore W3100702524C184670325 @default.
- W3100702524 hasConceptScore W3100702524C199360897 @default.
- W3100702524 hasConceptScore W3100702524C203479927 @default.
- W3100702524 hasConceptScore W3100702524C2777303404 @default.
- W3100702524 hasConceptScore W3100702524C31258907 @default.
- W3100702524 hasConceptScore W3100702524C33923547 @default.
- W3100702524 hasConceptScore W3100702524C41008148 @default.
- W3100702524 hasConceptScore W3100702524C50522688 @default.
- W3100702524 hasConceptScore W3100702524C57869625 @default.
- W3100702524 hasConceptScore W3100702524C58716799 @default.
- W3100702524 hasConceptScore W3100702524C6557445 @default.
- W3100702524 hasConceptScore W3100702524C72134830 @default.
- W3100702524 hasConceptScore W3100702524C86803240 @default.
- W3100702524 hasLocation W31007025241 @default.
- W3100702524 hasOpenAccess W3100702524 @default.
- W3100702524 hasPrimaryLocation W31007025241 @default.
- W3100702524 hasRelatedWork W2892127629 @default.
- W3100702524 hasRelatedWork W2904935195 @default.
- W3100702524 hasRelatedWork W2914138317 @default.
- W3100702524 hasRelatedWork W2953101770 @default.
- W3100702524 hasRelatedWork W2963579725 @default.
- W3100702524 hasRelatedWork W2963956929 @default.
- W3100702524 hasRelatedWork W2964049460 @default.
- W3100702524 hasRelatedWork W3024569256 @default.
- W3100702524 hasRelatedWork W3033026030 @default.
- W3100702524 hasRelatedWork W3034797957 @default.
- W3100702524 hasRelatedWork W3035840208 @default.
- W3100702524 hasRelatedWork W3036176146 @default.
- W3100702524 hasRelatedWork W3042103612 @default.
- W3100702524 hasRelatedWork W3042576877 @default.
- W3100702524 hasRelatedWork W3046881646 @default.
- W3100702524 hasRelatedWork W3098897816 @default.
- W3100702524 hasRelatedWork W3158712583 @default.
- W3100702524 hasRelatedWork W3162728429 @default.
- W3100702524 hasRelatedWork W3170173825 @default.
- W3100702524 hasRelatedWork W3170565703 @default.
- W3100702524 hasVolume "33" @default.
- W3100702524 isParatext "false" @default.
- W3100702524 isRetracted "false" @default.
- W3100702524 magId "3100702524" @default.
- W3100702524 workType "article" @default.