Matches in SemOpenAlex for { <https://semopenalex.org/work/W3174412103> ?p ?o ?g. }
- W3174412103 abstract "We analyze the learning dynamics of infinitely wide neural networks with a finite sized bottle-neck. Unlike the neural tangent kernel limit, a bottleneck in an otherwise infinite width network al-lows data dependent feature learning in its bottle-neck representation. We empirically show that a single bottleneck in infinite networks dramatically accelerates training when compared to purely in-finite networks, with an improved overall performance. We discuss the acceleration phenomena by drawing similarities to infinitely wide deep linear models, where the acceleration effect of a bottleneck can be understood theoretically." @default.
- W3174412103 created "2021-07-05" @default.
- W3174412103 creator A5011650393 @default.
- W3174412103 creator A5031329242 @default.
- W3174412103 creator A5033404184 @default.
- W3174412103 creator A5033616704 @default.
- W3174412103 creator A5049929304 @default.
- W3174412103 creator A5059333418 @default.
- W3174412103 creator A5061115157 @default.
- W3174412103 date "2021-07-01" @default.
- W3174412103 modified "2023-09-27" @default.
- W3174412103 title "Implicit Acceleration and Feature Learning in Infinitely Wide Neural Networks with Bottlenecks." @default.
- W3174412103 cites W1493832124 @default.
- W3174412103 cites W1567512734 @default.
- W3174412103 cites W2154579312 @default.
- W3174412103 cites W2212676342 @default.
- W3174412103 cites W2785626633 @default.
- W3174412103 cites W2788800397 @default.
- W3174412103 cites W2809090039 @default.
- W3174412103 cites W2910655610 @default.
- W3174412103 cites W2962939986 @default.
- W3174412103 cites W2964052793 @default.
- W3174412103 cites W2971043187 @default.
- W3174412103 cites W2981549002 @default.
- W3174412103 cites W3013634494 @default.
- W3174412103 cites W3035679810 @default.
- W3174412103 cites W3036827909 @default.
- W3174412103 cites W3038074040 @default.
- W3174412103 cites W3086778125 @default.
- W3174412103 cites W3088274487 @default.
- W3174412103 cites W3118608800 @default.
- W3174412103 hasPublicationYear "2021" @default.
- W3174412103 type Work @default.
- W3174412103 sameAs 3174412103 @default.
- W3174412103 citedByCount "0" @default.
- W3174412103 crossrefType "posted-content" @default.
- W3174412103 hasAuthorship W3174412103A5011650393 @default.
- W3174412103 hasAuthorship W3174412103A5031329242 @default.
- W3174412103 hasAuthorship W3174412103A5033404184 @default.
- W3174412103 hasAuthorship W3174412103A5033616704 @default.
- W3174412103 hasAuthorship W3174412103A5049929304 @default.
- W3174412103 hasAuthorship W3174412103A5059333418 @default.
- W3174412103 hasAuthorship W3174412103A5061115157 @default.
- W3174412103 hasConcept C11413529 @default.
- W3174412103 hasConcept C117896860 @default.
- W3174412103 hasConcept C121332964 @default.
- W3174412103 hasConcept C121864883 @default.
- W3174412103 hasConcept C134306372 @default.
- W3174412103 hasConcept C138885662 @default.
- W3174412103 hasConcept C149635348 @default.
- W3174412103 hasConcept C151201525 @default.
- W3174412103 hasConcept C152139883 @default.
- W3174412103 hasConcept C154945302 @default.
- W3174412103 hasConcept C17744445 @default.
- W3174412103 hasConcept C199539241 @default.
- W3174412103 hasConcept C2776359362 @default.
- W3174412103 hasConcept C2776401178 @default.
- W3174412103 hasConcept C2780513914 @default.
- W3174412103 hasConcept C33923547 @default.
- W3174412103 hasConcept C41008148 @default.
- W3174412103 hasConcept C41895202 @default.
- W3174412103 hasConcept C50644808 @default.
- W3174412103 hasConcept C59404180 @default.
- W3174412103 hasConcept C60008888 @default.
- W3174412103 hasConcept C74650414 @default.
- W3174412103 hasConcept C94625758 @default.
- W3174412103 hasConceptScore W3174412103C11413529 @default.
- W3174412103 hasConceptScore W3174412103C117896860 @default.
- W3174412103 hasConceptScore W3174412103C121332964 @default.
- W3174412103 hasConceptScore W3174412103C121864883 @default.
- W3174412103 hasConceptScore W3174412103C134306372 @default.
- W3174412103 hasConceptScore W3174412103C138885662 @default.
- W3174412103 hasConceptScore W3174412103C149635348 @default.
- W3174412103 hasConceptScore W3174412103C151201525 @default.
- W3174412103 hasConceptScore W3174412103C152139883 @default.
- W3174412103 hasConceptScore W3174412103C154945302 @default.
- W3174412103 hasConceptScore W3174412103C17744445 @default.
- W3174412103 hasConceptScore W3174412103C199539241 @default.
- W3174412103 hasConceptScore W3174412103C2776359362 @default.
- W3174412103 hasConceptScore W3174412103C2776401178 @default.
- W3174412103 hasConceptScore W3174412103C2780513914 @default.
- W3174412103 hasConceptScore W3174412103C33923547 @default.
- W3174412103 hasConceptScore W3174412103C41008148 @default.
- W3174412103 hasConceptScore W3174412103C41895202 @default.
- W3174412103 hasConceptScore W3174412103C50644808 @default.
- W3174412103 hasConceptScore W3174412103C59404180 @default.
- W3174412103 hasConceptScore W3174412103C60008888 @default.
- W3174412103 hasConceptScore W3174412103C74650414 @default.
- W3174412103 hasConceptScore W3174412103C94625758 @default.
- W3174412103 hasLocation W31744121031 @default.
- W3174412103 hasOpenAccess W3174412103 @default.
- W3174412103 hasPrimaryLocation W31744121031 @default.
- W3174412103 hasRelatedWork W2212676342 @default.
- W3174412103 hasRelatedWork W2899748887 @default.
- W3174412103 hasRelatedWork W2913473169 @default.
- W3174412103 hasRelatedWork W2952204734 @default.
- W3174412103 hasRelatedWork W2963504252 @default.
- W3174412103 hasRelatedWork W2970217468 @default.
- W3174412103 hasRelatedWork W2976713865 @default.
- W3174412103 hasRelatedWork W3003298109 @default.