Matches in SemOpenAlex for { <https://semopenalex.org/work/W3102905059> ?p ?o ?g. }
Showing items 1 to 89 of
89
with 100 items per page.
- W3102905059 endingPage "13237" @default.
- W3102905059 startingPage "13226" @default.
- W3102905059 abstract "Hypernetworks are architectures that produce the weights of a task-specific primary network. A notable application of hypernetworks in the recent literature involves learning to output functional representations. In these scenarios, the hypernetwork learns a representation corresponding to the weights of a shallow MLP, which typically encodes shape or image information. While such representations have seen considerable success in practice, they remain lacking in the theoretical guarantees in the wide regime of the standard architectures. In this work, we study wide over-parameterized hypernetworks. We show that unlike typical architectures, infinitely wide hypernetworks do not guarantee convergence to a global minima under gradient descent. We further show that convexity can be achieved by increasing the dimensionality of the hypernetwork’s output, to represent wide MLPs. In the dually infinite-width regime, we identify the functional priors of these architectures by deriving their corresponding GP and NTK kernels, the latter of which we refer to as the hyperkernel. As part of this study, we make a mathematical contribution by deriving tight bounds on high order Taylor expansion terms of standard fully connected ReLU networks." @default.
- W3102905059 created "2020-11-23" @default.
- W3102905059 creator A5049929304 @default.
- W3102905059 creator A5050776111 @default.
- W3102905059 creator A5061115157 @default.
- W3102905059 creator A5078102229 @default.
- W3102905059 date "2020-11-01" @default.
- W3102905059 modified "2023-10-18" @default.
- W3102905059 title "On Infinite-Width Hypernetworks" @default.
- W3102905059 hasPublicationYear "2020" @default.
- W3102905059 type Work @default.
- W3102905059 sameAs 3102905059 @default.
- W3102905059 citedByCount "1" @default.
- W3102905059 countsByYear W31029050592021 @default.
- W3102905059 crossrefType "proceedings-article" @default.
- W3102905059 hasAuthorship W3102905059A5049929304 @default.
- W3102905059 hasAuthorship W3102905059A5050776111 @default.
- W3102905059 hasAuthorship W3102905059A5061115157 @default.
- W3102905059 hasAuthorship W3102905059A5078102229 @default.
- W3102905059 hasConcept C106159729 @default.
- W3102905059 hasConcept C111030470 @default.
- W3102905059 hasConcept C11413529 @default.
- W3102905059 hasConcept C134306372 @default.
- W3102905059 hasConcept C153258448 @default.
- W3102905059 hasConcept C154945302 @default.
- W3102905059 hasConcept C162324750 @default.
- W3102905059 hasConcept C165464430 @default.
- W3102905059 hasConcept C17744445 @default.
- W3102905059 hasConcept C186633575 @default.
- W3102905059 hasConcept C199539241 @default.
- W3102905059 hasConcept C2776359362 @default.
- W3102905059 hasConcept C2777303404 @default.
- W3102905059 hasConcept C33923547 @default.
- W3102905059 hasConcept C41008148 @default.
- W3102905059 hasConcept C50522688 @default.
- W3102905059 hasConcept C50644808 @default.
- W3102905059 hasConcept C72134830 @default.
- W3102905059 hasConcept C80444323 @default.
- W3102905059 hasConcept C94625758 @default.
- W3102905059 hasConceptScore W3102905059C106159729 @default.
- W3102905059 hasConceptScore W3102905059C111030470 @default.
- W3102905059 hasConceptScore W3102905059C11413529 @default.
- W3102905059 hasConceptScore W3102905059C134306372 @default.
- W3102905059 hasConceptScore W3102905059C153258448 @default.
- W3102905059 hasConceptScore W3102905059C154945302 @default.
- W3102905059 hasConceptScore W3102905059C162324750 @default.
- W3102905059 hasConceptScore W3102905059C165464430 @default.
- W3102905059 hasConceptScore W3102905059C17744445 @default.
- W3102905059 hasConceptScore W3102905059C186633575 @default.
- W3102905059 hasConceptScore W3102905059C199539241 @default.
- W3102905059 hasConceptScore W3102905059C2776359362 @default.
- W3102905059 hasConceptScore W3102905059C2777303404 @default.
- W3102905059 hasConceptScore W3102905059C33923547 @default.
- W3102905059 hasConceptScore W3102905059C41008148 @default.
- W3102905059 hasConceptScore W3102905059C50522688 @default.
- W3102905059 hasConceptScore W3102905059C50644808 @default.
- W3102905059 hasConceptScore W3102905059C72134830 @default.
- W3102905059 hasConceptScore W3102905059C80444323 @default.
- W3102905059 hasConceptScore W3102905059C94625758 @default.
- W3102905059 hasLocation W31029050591 @default.
- W3102905059 hasOpenAccess W3102905059 @default.
- W3102905059 hasPrimaryLocation W31029050591 @default.
- W3102905059 hasRelatedWork W2039837136 @default.
- W3102905059 hasRelatedWork W2306077825 @default.
- W3102905059 hasRelatedWork W2308586727 @default.
- W3102905059 hasRelatedWork W2623572502 @default.
- W3102905059 hasRelatedWork W2752076530 @default.
- W3102905059 hasRelatedWork W2786718343 @default.
- W3102905059 hasRelatedWork W2796036701 @default.
- W3102905059 hasRelatedWork W2947323157 @default.
- W3102905059 hasRelatedWork W2950061277 @default.
- W3102905059 hasRelatedWork W2963025229 @default.
- W3102905059 hasRelatedWork W3005683144 @default.
- W3102905059 hasRelatedWork W3037755689 @default.
- W3102905059 hasRelatedWork W3105734402 @default.
- W3102905059 hasRelatedWork W3106311744 @default.
- W3102905059 hasRelatedWork W3135885752 @default.
- W3102905059 hasRelatedWork W3163053496 @default.
- W3102905059 hasRelatedWork W3166876196 @default.
- W3102905059 hasRelatedWork W3201882754 @default.
- W3102905059 hasRelatedWork W3211845999 @default.
- W3102905059 hasRelatedWork W4913547 @default.
- W3102905059 hasVolume "33" @default.
- W3102905059 isParatext "false" @default.
- W3102905059 isRetracted "false" @default.
- W3102905059 magId "3102905059" @default.
- W3102905059 workType "article" @default.